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. This voline is^the third of five vola«€6 describing, a 
iysteiatic approach for cbnst^Qcting task inventories, surveying the 

* task peifQtaance of occupations, and ajialyzing survey data tjcT 
det^Bioe tJbe appropriate' perf oraance conten^t. for "^ob training* (The 
approach, referred«±o as the, task survey process, is designed to be 

«of valua to both occupational icorriculua .personnel apd those persons 

, concerned With noncurriculua issues of occupational description , and 
updatii^^ of job content inf braation.) This voluae, through an 
explicit set ot procedural bteps, describes the design,^ 
^adainistration,^ and Analysis of . questiojpnaire surveys of occupational 
petforaanfee (surveys vhitih describe tW extent ^o vhich task 

^ MctxnitX^s are part of the job expect^cies of vczkers* in a 
particular occufiition or fungtioi/^. Four activities (presented in 
'8epar:ate' sections) afre included: planning survey design and analysis, 
adaintibtering questionnairi§ to worker - and sut^ervisor^t processing 
survey d^ta^ and reporting the survey results. (SB) . ^ / 
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P aatetials not available froa other sources. $BIC^ aakes every ef f pft * 

to ^obtain the best copy^ available. Heverth^lesk, iteBS of iarg'inal^ * 
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FOREWORD TO VOLUME 3 ' - ' 

* ' * • 

The Center for Vocational Educafton is continuing programmatic research to develop more 
effective pM-ocedures for identifying valid and nece^ry curriculum -content.' One product o^ this 
effort is the ftve-volume d^ription of procedures for constructing task inventories, survdying the 
task performance 6f occupations, and analyzing survey data tp aid curriculum planners ahd d^vel- ' 
opers in determining the appropriate performance CQrttent for Job training.^tHejDrocedures are 
irji^tended to be oyvalue to both occupationaHurriculunlSpers6nneliand(hosie pe/soDS cGDncerned' 
Wrth noncurriculum issues of ^occupational description and^updating of jgb contenMnformation, 

This set of procedures revisfes and considerably expands^Upbn an earlier verfioh of task inv^h- 
tory and survcfy procedures in The Center's report authored by \AOlliam Melching-ahd Sidney Borcher, 
R&D Series Nd* 9!;i%oc€jf/6/re$ for constructing and usinp task inventories, March 1973. The in jtial 
procedures profited gipatly and drew heavily fr6m the Report b^ Joseph Mbrsh and Wayne Argher 
^ at the USAF Personn«\Research Laboratory, /Vocedc/ra/ guide for conducting occupationbf surveys 
in the United States Air Fo^ce, Center development of the inventory and sunny 4}rocess has <:qn- ^ 
centrated on their'ad^tatiqr^tp purposes of helping in xYi^ derivation of curriculum contenr. Th|s 
adaptatioo has^inctud^ greater concern for how a task is stated, what task information ^ou Id be 
obtained, and how tcruse this tas^ inTortna'tlon in sel^ting the m^e relevant and critical content 
that warrants considefation as a leai^ning objective. , ^ " 



The total set of volumes in thi^ series consists of the following titles: 



J 



Vohime 1: Introduction. 

Volume StatTag the tasks of^e job. 

Volume 3: Identifying relevmt job perfonnance. 

Volume 4f.> Deriving perforfnance r^irements for training, * 

Vo/pmeS: Processing SiirvsBy data: Technic^i appendices. 



ThW/focus upon the perfprmance content of specific oq^patidns is parallel taThe Center's 
\ ihe cotK^ptual and a/yisotrVexontent of trainiv^, as published in earlier reports, R&D. 
FieTNo. 98 and Results of several research applications^f pordpns of th^process as it v^as ^ 



% 



l)eing developed arj? published as R&D Series AJo^ 86, 87^88, 108, 1(9/and 110. Currently under- 
wa%is an exploratory st^ay-of more generally applicaBlk skills that may be used in different occu- ^ 
pational are^s as welp^.^^ln^ particular occup$tipn. ^ckToccupationalty transferable skills dt 
competencies woulp seem to be uspful complement^o the present concern for job-specific content^^ 

Volufne.3, Iden'tif yfng Relevant Job Pei;formance,^^uides the reader through an explicit 9?^^ 

prbcedu rah steps, assuming that a compreherfsive list of potj^tidl tasks atfeady exists and^is avall^le 
*for Mse. THe.volume describes the design, administration; and analysis of questionnaire surveys of " 



occupational performdnce. The purpose of this stage of the process js.to prOciuce a description of 
^tbe extent to Which task activities are part of the job* expectartcies of workers in a particular occu--^ 
pation or function;>pr to differentiate between job types withln^arvoccupational area: ' 

The procl^^es ^benefit from a variejfy oi reported resea«:h studio and experiences of many 
* persons over the last several yeSirs, noxemy that work s)>onsjpri&d and conducted by th^ USAf Per ' 
sonhel Research Laboratory. There al50 has|)een extensiii^ input from the many vocational edu-; 
cators;^ curriculum developers, occupational instructors^ employers, job supervisors, and worker^ 
themselves who have been involved in various aspects of trying ogt different portions of the pro- , 
cess ^ported here. ^ . \* 

This volum^especiallv benefited from f iekJ tryouts of the original Procedures for constructing 
and using task inventories by severaTagencies and individuals. These tryouts were coordinatid by 
Earl Ru!»eil and.Gonnie Warren; and jnvplved the participation of eight state Curriculum laboratories 
wkhin^V-TifcCS (the Voc^cinal-Technical Education Consortium of States) in the development of 
19 t^k inventories.- Addifional tryouts were conducted by a local school district in Color^o.' One 
university professor qf vocational educatioii used the original report a§ 3 supphemental text. Sever^ 
/vocational education jfaduate students at The Ohio State University fHso^Cfmployed the reported' 
I procedure#in th^ir dissertation research. The cooperation of these participarit^ an^the useful feed^ 
back of their experiences with that. report are very n^uch appreciated/ Within the project-staff, 
Frank Pratzner, Duan^ Essex, Dai^kl Gilmore^and Earl Russell contributed sUbstintially to the de- 
velopment and tryout of the ofccupationaVsurvey procedures. 'Dr. Pratzner wastlirector of^he R&D 
progi'iam in ^hich jHe'five volumes .of this set were developed. *The, work of which this volume is a' 
part was^spbhsored by the Education and Work Group'of the Mational Institute of Education, with 
Robert StUmp serving as Project Officer. - ' ' - M " 

Continued improvement can be anticipated a$ wid^ e)fperience is gained in the implementatipn 
of task inventories and occupational surveys. It is hoped^the^pi^^ient procedural i^escriptio'ns may be 
of Immediate use and value in^kJing and prbmoting suclT implementation. By such means therb 
should be increasing assurance that curricu^ums and instructional mata^ials provide for^those thing; . 
Inost appropriately le^hed in a training program, and that students wifl bejearning skHls which are* 
important to ^nd r^ired for effective job performance. ^• 



Robert E. Taylor 

Executive- Director - 

Center for Vocational Eduution 
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^Given that a complete and acceplablejist potential tasks is available (fter directions given ig " 
Votume 2), the n«<t effort is to conduct an occupational survey of task performance. Such a sur- 
vey Sintended to obtain specific information about the fob performarfce of each task from many 
people directly kTiowledgeable db^ut work being performed in the occupations being studied. 

Volume 3 conveys procedures and guidelines for developing task questionnaires that may be 
used-to identify how relevant each^task is to a particular occupation. Job relevafKy information 
• serves primarily to describe and differentiate the occupations within the scope of interest. For pur- 
poses of developing or verifying the curriculum content of job training programs, this fnformation 
helps identify what work activities are likely parts of the job. Hpwever, not all possible tasks war- 
f^nt consideration in trainirigj programs. Expanded survey procedures are described in Volume 4 to» 
provide additional information about each task to help in deciding ^hich relevant tasks should be 
urained, and what features of a^'^task should be the focus of ^he.tKaining content. The basic process 
/of gathering relevance data is presented in Volume 3, to bfe of separate value' to thos^ users who may 
wish ofily to describe tKe performance content of occupations^ Usen^ishing to select.critical job 
content'for curriculum, purposes must follow both Volumes 3 and 4 tojpther. , - 



There are four major afctivities to follow in conducting Mcupatronal. surveys. First there is the 
design of the survey, including [^oth the advance planning of the< intended data analyses and' the 



des^ing of survey questignnaires th^^vyilt yneJcl ta^ data in a form tha*t will accommodate such* 
ar^lys*-' Thfe other three^joif activities pertain to the prodess of obtaining d|la on task relevancy , 
from* persons close^to anjl knowledgeable of ihe actual pferforrtlance situations. Using survey instru- 
noents called Task ^Inventory Questionnaires (TIQ), the three major activities involve (ahadmlmster-^ 
mg the TIQs to selected types of respondenjjs, (b>processing responses given to the TIQs, and 
(q) repoVting results ttjr others. Figure 1 depicts tfie* sequence and component steps. of^heseactiv- 
ities. Procedural stepSrare consecutively numbered tq follow .the first six step5 described in Volume 
•2. ' ' . _ ^ ^ , . . 

^DESIGN THE SURVEY ^* * ^ * w 



, PI«n.Data AnalyMs 

• N^ads 

• «Task Information 

• informant ^ 

/Backgrounds 
bat« Summaries 

Steps i, B, 9. 10 



Design Quastionnairas , 
and Thair Administration 

^ Formal and Samplmf 
•<PM»tt 



Staptll aod)2 



r 



r 



OBTAIN ^^EVANCY DATA 



Aitministftr 
Quastionnairas 

^ Arrangamantt 
^ Imtniction 

* *P^nting 

• Rloofnitidn 



Process TIQ Data 

r 

• Praphfation 
•"^ustarsiif 

niadad) 

• Summaries 

• Analytas 



Steps 13, 14 iaj> J' Steps 17, 18,19,20 



RefKMt the Data 



To Parttctpantf 

• Formal Record 

• Future File 



Step 21 
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Figure 1. Procedural steps described in Volunie 3. 



%The activities and procedural steps describecl in Vol^e 3 are intended to provide a tirfTely and 
representative base of current task perfornnance data, serVinjg to validate each task as it pertains to 
" \the separate occupations defined (ip Step 1) as of inter^t. Such j/alidation in turn may be used to 
• describe the composite of work performed in an occuj^tion or for subgroups Qf (workers. ' \ 

Relevancy of tasks to an occupation is variable. Some tasks are more reliant than others, thei 
de^e of relevance being a measure of dccupational validity/ Several kind^of information (as noted 
later in Step 8) can be of use in identifying how job relevant is each task. The present procedures 
for assi^ing relevancy rely prfmarily upon the percent of work^perforrping a task and the extent 
to whlbfKthat task is judged to be a part of the job of workers in the occupation. Th^ measurement 
issub re^rding job relevance is not whetl|er or not a task is relevant, but to what.degree it ap|5ears 
as part of representative work assignments. Thus, any one task may be relevant to several related 
' occDpations, but in differing degrees. T)r, a task may be highly relevant for^new workers^ but jiearly 
nonrelevant for very experienced sepPor workeVs. Such distinctions -can serve to differentiate be- 
tween related occupations b*r between particular subgroups of workers withi^ an (kcupation. 
• ' - • - « 

Tfiis capacity to<listinguish between different groupings of job assignments is called upon in 
Step 18. Using various statistical techhiques it is possible to usef'task relevancy data-to identify 



•clusters of highly similar work. That is, job'pos'rtions in which v^dt)^ers tend to perform the same 
tasks (and these tasks have Smilar patterns of significance to those workers) would' faH into one 
cluster. Another set of job positions that do somewhat different tasks (and where the sigmffcance 
Ifettems of any tasks common to the first cluster are^alSo diffei^nt) would faH into a second joV 
cluster. " . ^ ^ . ^ ; ' . 

• ' Analyzin\| jobs into clusters of similar work is i^f^st helpful when studying an occupational area ' 
where the distinctions between occupations are somewhat fuzzy ^d uncer,tain, or when studying an 
-occupation that is stil^ evolvijng and undergoing change. Failure to distinguish between job types can' 
result In misleading validation c)f tasks, with relevancy infprmatioi;! beihg summed across a hetero- 
geneous mixture of job positions sucfythat any summaries may not accurately pgrtray ^hat tasks ' " 
are relevant to any, actual-j6b or occupation. . . ^ • 

' . Where the pccupations can ^ well defined in advance, or^here clearly only one occupation is 
to be' studied, thpn the survey pr^ess becomes much less complex. It simply invqlves the following 
actions: . '\ . * 



— T — ■ — : — ' 

Given (a) the definition of the^ope of occupational^ training interest and (b) thecomj^e; 
hpnsive list of potential tasks performed by. workers within the scope defined. . ' 

, • -tin accordcipce with Steps 1-6 of Volutne 2) ' 

• Select the questions to be asked about each task to provide desired descriptive data^ 
on- task relevance. , i . ' ' ' 

Design a sampling plan to obtain representative task data (tliat is, decideliow nTiany 
and what^types, of persons are'needed to.answer the surveyt ^ 

Pretest th^ survey instructions or any hew question formats. 

^' ' . ^ . If ' . . 

• Make arrangement^for having the survey questionnaires administered to the types 
/of persons that are wanted. . * * * . * 

• Print and distribute the task survey questiormaires to selected respondents. 

• Prepare the returned questionnaire data for computer'processing. 

• . ■ A* 

• Compute descriptive summaries of responses to each task. , Do this separately for 
each defined job type or for particular subgroups of persons answering the ques- 

• tionnaire. - # • 

• Perform desired analyses of the data sumnr^nes, such as comparisQi^etween oc- 
cupations or subgroups, or a ranking of tasks on their degree of rele^hty to one ' 
occupation. * 4 • 

• • 

• k Prepare repi^rts of the survey and ariajysis results. 

» 



These nine actk)n$ correspohQ generally to, Steps 7 through 21 as described in this volume, with 
IflSr exception thft Step T8 (Clustering) is unnecessary when the occupations surveyed are already 
weii defined. Descriptions or procedures and guidelines for accdmpflshing^his process are^iven in 
• detail in this volume. ' . ^ ^ 

. Several opttofts are discussed, to accommodate a v^iety of special situations that may arise or 
of special studies ^t may be desired. It is hoped that sucli detail may be of help when doing sur- 
■ veys few t^e first time or when particular probler^sVe encountered. However, do not lose sight of 
the fact that the bccupatio^l surveys are really a very straightforward ^process of administering ques 
tionnaif^^ to a grojjp of knowledgeable persons. When the bounds of the occupations to be studied 
are unclear, then the job clustering of Step 18 should be used to idemify the differential work per- 
formed in component job types* It then becomes possible to summarize the questionnafre data to 
describe^he relevande of each task to each identified job type or occupation. 
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• ACTIVITY D: fUNl«lltfG 
ISUR\/EY DESII»N J\1\ID ANALYSIS 



DESIGN THE SURVEY 



PUnOatH 



' • Ti^k Information 
•* informant ' - 

* Backgrounds 
• 0«ta Summarws 

^ SttprT, 8/9, 10 . 



DosiBn Quaition- 
nairw pndThair 
Achninittration 

^ Format an^ 

• Pratait 

Stapfriand12 



obVain relevancy data- 



Admintster 
QoestK>nnaifes , 

• Arrangements 
• ' InstruAion 

• Printing 

• Re<?ognitK)n 

Steps 13. 14. 15. 16 



Proceai^fQ Data 

• Praparation 

• Clusters (if 

• Summaries " 

• Analyses ' ^ 

Steps 17/18. 



• iReport the Ofja 

^ i% T^ Participants^ 

• rormal Recofd , 

• Future Rle« 

: *st/p2i ^ f \ 



4 . ^ 



A*-, 



area, 



GiveirT^e availability of an edited and pilot tested Mst of potential 4asks for an oqujpalipn or 
, arid before obtaining field data on the occupational relevance of each listed task'/there is a 
nee^-to plan -the intended survey: its design s^nd appropriate analyses, "(t^is advance planning Is the * 
focus of Activity D. There are six procedural Steg^o be performed in j^arryiag out thi$ planning ^ 
activity: ^ • ... 



V 



Step 7: Determine What Results Are to Be SoughV 

Step 8: iDetermine What Task fnfbrmation Is Needed 

1^ Ste|b 9: Determine What Respondent Information t^s Needed < 

Step 10: Determine What Data Summaries, and Analyses Are Needed 



1^ Step 11: Disigri'Survey and Its Administration 
1^ Step* 12: Pretest Questionnaire Instructions and Format 
Eacht)f these stej)$ is described in the sections which follow. 
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STEP 7: DETERMINE WHAT RE^ULT^ AR^TO BE 
SOUGHT. - ■( ' l ■ 

Th^ defined scope of ifiterest, provided by Step 1 , now serves as a starting point for deckling 
what inforTDation or descriptions qre desired. It-is necessary in Step 7 to clarify fully what results 
'ard^Waiitdd from the occupational sCfryey and subsecfiijmt analyses. Such clarification wtll help as- • 
Ikijpe that tW'survey will gather ^the type of data heededand In a form'that will be useful. ^ 

^ Jo^ relevancy data can be used for several purposes, particularly to provide descriptfons of: 

• Work activities performed i#i-.a^sins[le occupation, serving to define and validate the per- 
formance characteristics of that occupation, ^ " - /** ' 

• . Differences in work performance a$ a function of \o\} focation, type of industry, len 
df job experience of the workers, job specialties within the occupatidti, source of trai 
or other background characteristics of the personsTanaA^efing the surypy questionnaire or 
of the employment setting. ' . ' \ 




» 



Cornparisons of Sjnsiilariti^s and differences of the work^lDerfprni^ed in- two of nriore oc<^- 
pations. ^ ^ - ' . ^ * * - 

* ^ > % 

jTrends, over time, of changes occurring ip the work performance characteristics of an oc- 
cupation. ' 1, * " . ^ • . 

't)cfcupational^clusters existing within an occupational area. ^ - J 

OusteVs of job speciartt^ies existing within an occupation, or which are evolyirTg^ . , 

Comparison of jot/pterform&nce re5quft%ments as v^etved^by different types of pe?bor1s 
^ (for example! wof Hers versus tfnmediate supervisors, workers versus training personnel). 

, • ■ ' S ; . ■ . . 

Etftabiishinawhat data" summaries andt'^nalyses are ne66issary to achieve the desired informati^jn 
' oFcoqplusions will help in deciding (io Steps 8 and 9) what task and respondent informatiOrr^hould^, 
beigathered by the survey. As appropriate, prdcedu res/given in S^teps S and 9 will note spec^Ve- 
quiremepts for particujar types of intended analyses ^d despriptions. 

STEP 8:. DETERMINE WHAt TASK INFORMATION 
ISJB^DED ^ 

Contern for task information^ involves both what cfUestitJns to ask about each task and what 
type^f person is to provide afiswers to each task question. It is recommended that at least two dif- , 
ferent types^of persons answer task questions to provide tfases for measuring the lob retevancy of - ^ 
each t!fel^These*tw<M|icpes usually shoufd consist of workers and of supervisors for each occupation, 
•with workers reporting on the activiCTes^they actually perform, fend supervisors reporting a composite 
of wh^t the^ expect reprt^bitative wbrkiT^ to.do in the>r operation. Agreenpent by both types that 
a task is of very low or Jl?rel|vance to a specified occupation serves to id6ntify tasks which -can be 
c&nsidered as "nonreJevant". ^ . ^ ^ W 



By the t^«group procete^ from their differincf perspectives of the ocdipation, the l^ihooB 
is increased mat conciusiori$ about t^ relevaricy will lie reasonably sensitive to the work activities 
actually perfocmed and also sensitive to broader perspectives of what is mtended and expected th 
the near futuife. For e^cample, few workers in the $ecretarial field mi^t b&expected to indicate 
current perfbrmance of tasks associated with word processing systenis, wherea9 suoecvtsors might . 
be awarf of forthcoming installation of such systems^br of comparable new tech nm^g^es expected 
soon to be impacttn^upon the occupation.^ if only current worker activity were used as the basis 
of measuring rel6vancy||^her6 could be a danger of considering as honrelevant thos^ tasks just be- 
, ginnfrig to emerge as part of the occupation. And, conversely, tasks^beginning a trend toward ob- 
•solescenbe coutiijk the momentY9f measu/em^nt be judged undujy high in relevarice to the job. 

An exception to the two-group process is necessary, wh^ the survey datS are to be used to*. 
identify distiqct jo6 types represented w'gthin a pool of wprkers answering a Purvey questionnaire. 
*To apply the. statistical clustering routines foV such identifications (Step 18), usually only the re- 
sponses ©rpersbrts teHing what they themselveS.do are used to derive clusters of comparable job 
' positions. Additionally, only one question asked about each task is used in the statistiAf cpmpu- 
tatipns. - ' ' , /. 

^bsequent to the identificatton of each of the job types, it then becomes reasonable to apply 

ttwo^ogp process for establishing the relevancy of each task to a particular type of job. Super- 
r ratings need to be obtained separately for each specified occupation or job type. ^ 



*^lf I 



Jf it is felt fhat the defined job types (Step 1 ) are adequate for the needs of a 
rticular study. Step 18 clustering may be omitted. If not adequate, cluster- ^ 
g must be accomplished before ft is possible to administer questionrlSires to 
persons other than workers describing therr own job. 



Tysk questions for. describing job relevance. Questions regarding.the ^occurrence" and the • . 
"sign\f icance" of tasks are used to measure job nelevancy . Each may be asked of immfediate super; 
visors as well as of the workers actually doing the job, creating in effect four specific question?: 

1 . Actuar Task Occurrence (asked of worJcers) 

During the test year or so, which of the listed tasks have you performed? 

2. Desired Task Occurrence (asked of immediatelD^rvisors)' 

y^p^ch of the listed tasks should be perfornr>€cl by such workers in your operation (or ^ 
• - ' office, firm, shop, garage, etc.)? ^ 
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• 

How »gnificdnt a part of, your job is each listed task? ' 

4* Extent Taslch Part of the Job] (asked of immediate supervisors) 

How significant a part of th^ jot\of siifch workers' in your operation is eiach listed task? 

Instructions and respon* scales for each of these four task questions are illustrated in Ste^J^I . ' 
QuestfQHS 3 and4 are an adaptation of a scale proposed originally by Hemphill (1960) for the study 
of the activities of business executives. All of thes6 questions tend to provide highly reliable gr^p 
data. . . . : I / , , 

Some other task qti^5tions.t|jat have been Osed at vartous tinjes by others to describe job rele- 
vance and task performance are^oted in the Appendix^ If any such addrtibnal descriptiv^^ask frifor * 
mation is desired, it can usually be added to the survey questionr^ires using Questions 1 , 2, 3, or 4. 
Qeneraliy, no jnore than one additional question should be asked of any one respondent, so that no 
individual needs to answer more than two task questions. 

Additional questions for use in selecting tasks for training. Information about thef job relevance 
of each task is certainly one important ingredient for deciding which tasks need initial or^reeriiptoy- 
ment training. Tasks performed by a majority of workers innhe first fevy years of employment 3re 
common candidates for inclusion in formal training programs. Training for tasks performed by rel; 
atively few workers i^y, less than 20 or 309M is typically considered as not cost effective for school- 
Msed4>reert1ploymel^^proy • * 

/ ^i. '-, 

- Additional task information is needed, however,lo spfecify more jirfecisely wWch relevant tasks 
warrant school training, and to what level of development. Questions to support such decisions are 
presented in Volume 4. These questions Would be administered concurrently with relevance ques- 
tions when^such task data are desired^ \i ^) 



Options for questionnairttty pes when surveying a single occupation. It cap generally be anti- 
cipated that one qf three conditions will exist with regard to the availability and knowledge of per^ 
sons close to the m^oded performance^ituation: ' . 

Condition I - (^S^ively many experienced and knowledgeable workers exist, and there 
.are proportionately fewer Immediate supervisors available or directly 
knowledgeable of the occupation. 



^ Fo^ those readers familiar with the previous occupational survey reports of Center BftO 
^ Series ^Jo• 108, 109, and 1 10, Question 3 here is identical to Question 6 in the reports;. Question 
4 was not in*the rejSorts, but is ^^n adaptation of the prior Question 6. Sqme 12 task questions 
were included in these earlier^studtes. Only selected^ones of these are recommended in the variousij 
types of queSttennaires in Vohame 3, and a couple others are mentioned in Volume 4. The t^h- 
nical grounds lor the-selection of task questions is efffered in^\)^um^5. • 
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condition II - ' Relatively few experienced and knowledgeable workers eiyrt/but there^ • 
/ are relativefy many supervisors available i^ho are directly knowledgeable 

\ ^ * of tfte occupation (sucJh as When there is a very low worker-to-supervitor 

^ "ratio, as may occur in small shops and offices). , 

Condition til r- A newly evc^lving occupation with few experienced and knowledgqdbl^ 
. j|kgrorkers existing, or Other situationsnh^r^ most "wpf kers" are not anti- 
cipated to bfe very knowledgeable^f the.occupation. this "couW 
for some selected lif^^performance situation Where segments of the. pub- 
lic mi^t operate'^s the "workecs/' and key ir^ivkluals in the communities 
(or subject matter specialists)^serve as the "supervisors'* for the purpose of 
survey responses. \ * ' 

Under Condt^bn I either of two' survey types cani>e use2i^4f ortly relevance data are desired: 

* i .Type A, . using Question 3 (Extent task Is Part of the Position) with workers and? 

Question 2r4D6sired Task Occurrence) with immectiate supervisors. 

• Type B/ using Question 1 (Actual Task OccurrencW with one gfoup of workers, 

Question 3 (Extent Task Is Part of the Position) with a comparable seconc^^ 
group of workers, and Question 2 (Desired Task Ocdurrence) with imnpediate 

supervisors. * ' 

* ' ' ' f ' " 

' V / k ' ^ * i 

These survey types. Types ^A and B, are the prereri^ed vec,sions«|Dr most conditions that wMI be com- 
monly encountered, though additional types are cited below for use^krsp^ial circumstances. Type 
B permits additional verification of task relevar>eV, useful when si^fficientfiun^^pf workers are 
available to suA/ey two separate groups. This type als9 collects dir^tly cbmpajrabfe'data from both 
worker^ and supervisors, making it possible to detect wide differ^ces b'ttween worker performance 
and supervisor expectations. .A survey type using only Question? land 2 is not recommended since, 
for about the same amount of administration effort, it is ^ssibie to obtain additional usabt^ task 
information by also*asking^hjestton 3. . ' . . 

Also tmder Gonditipn I/when it isdestr^ only to survey workers, a third type can be of use: 

• Jype C, using Question 1 (ActuafTask Occuri^nc^J with ontj^roup.of workers andA 

Question 3 (Extent task Is Part bf the^Cftition) wrth i comparable second / 

^ group of workers. ^ . ^ 

' ^ - *\ ' ^ 

An occasion for use of this type of questionnaire might occur when ^ professional or labor associa- • , 
tion wishes to survey its membership to determine the extent ]p which they perform *tasks of t|ie 
.^scipline s>^ craft. Analyses Could then be accomplish^ ^dn the basis tff different background 
characteristics of those responding, such as experierjiced workers versus inexperienced worfcers. 

Under Conditions II and III eUther of two other sdrv^^^^ypltpcan^be used: * ^/ 

• Type D, using Questton I'fAqtuat Task Performance) with wbr^ri Question 2 (Desired 

Task Occurrence) with one group of tmn>ediate supervisors, and Question 4 
* . (Extent Task Is Part of the Job)ivitft a comparable second group of supervisors. 

• Type E, using Question 1 -(Actual Task Performance) with workers and Question 4 
' ■ ' ( Extent Task is Part of?the Job) with immediate wperyisors. 



These five questionnaire ,types are summer izedjn Figure 2, a|png with an indication of when 
each might be used, depending on the anticipated availability and knowledge of worker and supen 
vtsor droupSr. . . • ' . 

\' Options for questionhaire types when also identifying ipb clusters. To provide the task data 
t^eded in St^p 18 for applying statistical clustering rbulines, several additional survey types may be^ 
used. These usually should be used, however, orvly when very large numbers of workers are available 
to be surveyed. Tht^ugb.some statistical clustering procedures for small groups (less th^ 200)' are 
noted in Step 18/these woulc^ be less preferred than those 'which handle large rtumbers of respwon-, 
♦de ^ts (sy ch ^s on the order of 2,000 persons). 

• Type F, using Question 3 (Extent Task Is Part of the Position) with workers through- 

out the occupational area. * ' • 

• Type G, using Question 3 (Extent Task Is Part of the Position) with worker/ and, after 

clustering, Question 2 (DesT^red Task Occurrence) with supervisors of each iden 
y lified job cluster. - ^ , - . 

Another task question has been found useful in a number'of occupational studies conducted 
by the Occupational and Manppwer Research bivision (AFHR L) ancf the Occupational Measure- 
ment Center (ATC) of the U.S. Air Force, it Ls par^ularly effective for identifying clusters of j6b 
types if one has access to their CODAP (Pompreh'ensive Occupational Data Analysis Programs) com- 
puter program system that was developed to analyze and report occupational information collfedted 
with task inventories (Christal, 1974). The grouping program within CODAR makes us6 of data pro- 
vided by the question tq compfite the overlap of each pair of workers responding, this in turn servmg 
as the basis for extracting clusters or groups of similar vvork performance patterns. This additional 
task question is: y 

5. Relative Time Spent (asked of workers) * ' 

^ ' / ' • ^ 

" Cbmpafred with aH^er tasks you do ia your |ob, how much time do you spend doing 
e^h one of the liste$tasks? 

Though this question is ^lot part of the prbce^Jpres generally recommended in Volume 3, it is cited 
for possible use when there is a need-anti capacity for clustering occupations by means of the CODAP 
grouping program. Further mention of the processing of'Sata obtained by this question is noted un- ► 
der Step. 1 8, Clustering of Respondents into Job Types. Step 1 1 , Design Survey and Administration, 
illustrates a typical questionnaire format for Puestion 5 used along with Question*! . 

wien it is desired^ to use the 'CODAP clustering programs fojj^ntifying job clusters. Question 
5 (Relative Time Spent) may be added' to Question 1 (Ac&||l task Ooiurrence) on survey Types C 
and E, or used'with only orte large grouiD of workers. Thi^oduc^ Types H, I, and J. » 

Figure 3 sumfnariaesjthese five questionnaire types for gathering clustering data along with task 
relevance information. ^ 

'Selecting the kinds of ^rvey'respondents wanted, h'he general^ rule for selecting the Itipd of 
persons desired for-answering task survey questions is toselect those vvho are closest to and imme-' 
diately knowledgeable of the actual wiOiii;/( activities being performed. Most typically this wil l be 



Summary of Questionnaire Types for Surveying Task Relevance: 



Questionnaire 
Condition Type , i 


Workers 


^ o — ~ 5 

^ Supervisors 


. Group 1 Group 2 ' 


Group 1 Group 2 


1 A 
1 B 

'1 ^ ■ C 

.'-III ' * ; E . , 


Question 3 

Question 1 ' Question 3 
Question J ^ Question 3 
Question 1/ 
Question 1' 


* 

Questidft ? ^ 
.'Question 2 • ' 

Question 2 Questior>4 
. Question 4 >f:^:^^, 



• Reconfmended Options for Different Levels of AvailabJe TieSpondents:- 



Availability of Workers 

' ye|y M^ny, at^Sl Experienced 
Many/and Experienced 



Relatively Few^ but Experienced" 

^ Few E^ipenenced, Most Not Vfery 
^^^owledgeable of Job So^pe 



Availability of Supervisors 

' ^ — I ' ' 

Many, and ^ ^ Few, or Limited 

Knowtdligeabl^ ^ Knowledge 



/ 




Types A, B, D, or E 
* / ^ 


Type C 


. Type B Preferred, Or 
Type A 


Type B Preferred, 
or Type A ^ 


Type^A Preferred, or 
Type D 



Type A 


Type D Preferred; or* 
Type E 


Type E 



Figure 2. Summ^C^of mjestionnaire options for. surveying ^ 
task releV^ncft iSBH^^ occupation. 



djMMring Plus Relevance Questionnaire Types: 



Type 


Situation ' 


! Workers 


Supervisors 


> 

• 

G 


Clusttring withih ar>/^rea,Mahy 
Workers ^ ' 

Clu^ering withih art Area, 
Supervisor Con^firmation Dftsired * 

' 1 • • 


Question 3 ' 

' Question 3"". 

V ' ? 

[ ' J ■ — 


\ 

. Question 2 (after clustpr- 

; = — 



'b 




CODAP Clustering Plus R^Ievai 



™J 1 

Type 


• Situation * *j 


\ n 1 ' ^ 

^ Workers ' • . ' ^ 
Group 1 [ ^ Group 2 . 


• 

Supei^isbf^ 




Qtust^rs afhd Releyance, ti,o 
Supervisor Confirmation of 
Relevance . * 


QiiestiopS' Questk>n3 / <j 
/ 1 and^^ . (after clustering)^ , 




1- 


Clusters, Followed by 
Supervisor Confirmation * 
of Relevance 


Questions 

1 ancf 5 * ; \y * 


<2uestiop 4 
(after (Jlustering) 

r 


J 


^Desire Clusters jdnly^ ' * 


Questions , ^ * ' 
1 an(^ 5 , ' / ^ 


• — i_ 



Figure 3. Summary of questionnaire options for use 
in pluttering jobs in an bccupationararlM. 
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mP«:TAtK 
WFdflMATION 



\ AfW9fkefsjnthat(^^ Only rarely 'find^f / 

specHarctVcuin^iH:K^ should the$e respondents'be instructors in occupajtiorjahtrainlng programs! 

/ * Wh^^mwBte^ it is recommecide<J'tha(lboth workers and immediate supervisors be su'rveyeil. * 
• This helps^^Mfe a balamce^between actual performance and de^ed pjftrformance. Vyorkers respond 

only to what t^oVnit^W indivrdually; whereas each supervisor sums across several employees to 
^ provide.a'ratii5g4|^^ of all^workeffe of that type under his direct supervision* To- 

gether these twpl iSTO f^ sources car>yreld good profiles of task relevance'>A(hen using relatively few. / 
' respondents.' Hoiy^f;PR^V<he/e it is pbssiBle to survey very largp number?. pf workers in tan ocpupation 
J, " (for4nstance^ several thousands of^drkers), then it betomes n^re reasonable to^mit the supervisor 
questions ^^Sisr^t%i\/e basis fpr Vheasyr/nq relevange.^ 



.1 ' 



',lt is also possible to specify the SURVEYING GF WORKERS HAVfl^G CEEJTAirsi AMOUNTS 
OF WORK EXPERIENCE IN AN OCCUPATION. This is particularlylmportant if the purpose of 

u the study is to id^nt\{y vyhat is relevant to.some limited portion of the work f6rce. For example, if 
* the study is intended for use in deteripining performance content for preemploymeat or initial job 

^ training for an^tablished ocpupation, thep workers with ^rom^ t)?vo to 10 years of 6ccjjpational ex- 
perience shojiJti predominate in tifte survey. -TKis^ range avo^s a dominance of tesk data from those 
with ver\^^imited or very'extensive fob experience. A majority of very experienced wprkers wogid 
tend to pi^ovide unreal isj^ job activhty upon whIcK to base the training needs of new w.orkers. 

, 'Supervisors sftould^b^^nstVucted to consider primarily workers with such experience whe/i answering - 
theirtask ijuestfons/- • ' ^ - \' . . 

/ WHEN-THE COMPLETf odfcUPATIONAL SCOP^ffs 6?= INTEp-EST, then the length of job ' 
experFenceor of Careei progression can be sampled to obtain similar^numbers of respohdents from 
each experience fev^l^For instance, the e)q3errence ^els cojjWoe divided as follow^: ^ ^ 

y • Less than twQ>eaf^-*r about one-tHird of the Workers 

^ • Two to 10 years W .aboert one-third of the workers 

. • More tVah 10 years — -^about one-third of the workefs . 

- - Some knowledge of thfeexp'erience characteristics of the worker population is useful to ^t 
meanin^ul lirrrmion the range 6f experi^ncg-desiredr Thus, if nearly aJI available workers have orfly 
a yeir or two of experience, ^ might apcur rpr a very new and en>ergfng pctupatiqn^ then obviously 
thpse with littl§ experjence^must predominate. , No one rule wifl fit all occupations. . > , - 

It should be cautioned, however, that placing/restrictigns on the population to be surveyed wjll 
cause increasing diff rcuity'rn administering survey questionnaires to the desired people. ArkJ Jt be- 
comes nearly impossible to instruct supervisors Qg what types of workers to report job performance. ^ 
For most general purposes it is simpler.to specify different characteristics of thfe empldyment setting ^ 
than of worker pr supervisor characteristics. Ttjrus, typfes and sj^es bf ^ployingiirms, as well as geo- 
graphic locations, can serve td produce representative "task ^ata, with only a genfera[ instructiAj tb ^ 
' focus upon persons^within some'broad range of 6xpe(8pnce. ; 

■ ' ' . - ' ' ' * . *^ 

Supervisors'shou Id. preferably have at least /our y/ears recent Bxperience supervisipg workers 
of the particular kind involved in the study. To thd extent possible, seek personsVvhc^have had ex- 
perience directly supervising a number of workers of thfs type, if more tH&n one occupation is in- 
cluded io the Purvey, then different supervisor questionnaii^ are needed for each specified occupa- 
;tion. This requires tHat the occupations be knQwn in' advance^ If they are not knovw but neb3 to • • ► 
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be kfemif iid ^ ipb ctuffefmg procedures (Step then data for such ^us^ering must be collected 
aQd'ma|yzedt>ef9rradmininering thesupefvi^t^ • ' 

• » . \ ' . \^ " ' # • ^ •* ' 

, N For m9«|t curriculvim content purposes the objeetiye is i# Purvey the BANGE OR EMPLOY^ 
M^T SETTWQ^ifiWHlCH tRAINEES OVER TIME MIGHT FIND THEM9ELVES^S£EKlNGr 
EMPLOVMENT. With the highVobility of ther population, this objective directs tflat a varrety of 
geographk) or regtonal locations, c^munity sizes, employer sizes, and emplqyinjg Industrie ]^ the 
foCMS off 'most occupational perforntance surv^s. ^ ^ ^ 

. . ftnere may, however, be special purposes for a survey that direct attention to other'samnpling 
variables. These nlaVn^ll juStify high concern fdr obtaining responses of particular types of vyopk- 
ers. Or they may indio^te^tha^ peis^ns other than workers and immediate supervrsors should be 
surveyed * • * ^ < , ^ 

• ' i > ' / 

NOT^: • Worker characteristics ate nojt especially Important when the^urpose of the survey * 
is to aid in validating thecbntent ofjobs, for use in constructing nondiscriminqtory employment 
tests. It is t;|ie test ^nd its performance coptent that woukJ be subject tp^'analysis for differential ^ 
impact oa^various typeset peo^e, not the performance content of the job itself^ .However, worker/ ' 
characteri^ics could be of int|re$t for describing the occupatipndl performatige of succes^fiil-worlc^ 

who have particular (5hysic^l^handicaps or who have varying levels^of education and training . 
backgrounds. 

• * Undef,Conditjons H^and III cited above, survey emphasis is placed on DATA FROM PERSONS 
OTHER THAN WORKERS IN THBOpCUPATION. ^me^rforjnance^^eas justdo not contain ^ ' 
enough available p!efsons doing the activities to'provMe a SMrce of know||'edgeable survey respondents. 
,This can oq;ur vThen the wbr)%r grptip may not be suffici^tly literate to read and understand the task* 
statements and questionnaire instructions (profiibTting'tt^e use gf Questions 1, 3^ and 5), or when the 
*occbpatiph [s so new and rapklly evolvlng^that the performaoce^^f present workers justcannpt be ac- 
cepted as fepresentati>/e of thcf intended occupation. This situation dbcurred a decaide agcf with the 
occupatbn gf Teacher Aide. The early use of Teacher Afdes wasJthefn limited forthe most part to 
pN^rwork and child custodiar chores. Teachers, counselors, and aolministrators would have been 
more useful sources of the iikely signif id^nce of the potential Work activities (Question 4) than woukJ 
have the earlyr^of kforce in that occupation. Whife there were.notable exceptions to th*^ status, W- 
wouM have been;dHficul^t to locate and survey th^ at the time. . 

^ ^ * Aj^her possible situation calling for an ^nnph^is'on surveying persons other tharf^he workers 
^WHl^ THE PERFORMANCE AREA IS NOT AN EMPLOYED OCCUPATION, BUT IS SOME . 
OTKERpEFINABLEPERFORMAI^JdESlYUATION. For instance, it might be desired to sufvey 
such a life performapce ^netion as the purchase and ^ale of a resi(Jenc$. This could include t^ks 
'pertaining to obtaininglRortgage'.frnancing, using reat estateffirnrks, identifying property restricti^ons 
and eneumbr&ndte^, evaluating m^ts df the sale^ as weti as keeping and usirt^ records to calculate .the 
dost basis for ttx^Air^oses. Foilbwing the general rule for selecting survey' respondents, the persons 
c|o$est to and tmrirmliately kjiowtedgaab le of tihe activities to be perf ornSed may be real estate, fi- 
nancing, and taklpieCtaUsts. Or, ttiey niay include community individuals who have a^)ecial interest 
in upgrading citizen ability to perform effectively in this fu(K;Tton aikf wh'Sl^ve knowledge of ioe 
present iimitationj^ of key segments of the community for wh^ftf^ill upgrading rs needed. Thus, 
while the sutwey approach can be appropriate, its application may have to be flexible to ac<^n1mo- 
date^ipecial puit>q9es to be served. 



^ STEP9:ltEtraN0£fn 
^ * ^ * . mfORMATION^ILAM 

^TEP 9: bETERMINE WHAT RfeSPdNDENT 
.INFORMATION IS NEEDED . 

Ptnonal data. D^nding upon what analyses are to t>e performed (as descried in Step 7), ^ , 
background infom^tion to be given by survey re^ponbents tan be of different ^xts. At a minimum, 
ii) most cases, iris lisefut to ot^tain information that server to describe the type^ of persons who. /id 
answer the survpy questionnafres. This might include their }ob title; the IrKkistry in which they work, ' 

, and their length of work experience in that occupation. Figures 4 and 5 illustrate background pages 
^at could be part of a survey qu^ionnaire, one for workers and one for supervisors. These are only 
suggestive of whatj:)uestions oan be asked. Each application may call for a different set of back- , 
ground iten^s. Such information alto serv^ in Step 17 to verify that tKe intended kinds of perspns 

""did in fact.answer the questionnaires. " 

Notice in these examples tbat very little background information is sought andthe effort re- 
quired to answer these questions is minimi^^acl Sinc^ the survey questionnaire seeks to focus atten- 
tiorf and thought on^k infornwtiph, it is nOT^ood to distract from that focus by including leng]thy 
and difficult background questiDns. The rule is^to coUect only wjiat is important to thB stucfy and 
to do so in a form that is reasonably quick and^easy to answer. Ifhus/Checklists of the most likely 
answers help simj^Ufy the*response effort (as well as simplify the processing of all questionnaires by 
assignment of computer cdd^ to ^t^b answer). Any time of frequency questions should caJI for an- 
swers in the broad^t quantity ^*)it^ that will be useful to the study (for example, yearf of experiepce 
. instead of years and months). • " , * . . 

' . ' ' ' • . " *• 

If wdrker training background alsols desired. Figure d illustfates pne possible format fo/ getting 
>nses. Information on employment Variables such as geographic location and size of firm 
usually n^^not be asked, since this informatior\^ould already h^ve bpen determined thg person 
admintst^in^uestionnaires to workers and kipei^ . ^ • ^ • 

Unless of special value to the*study, no personal information^shouldbe asked: keep the ques- 
tions directly pertinent to the study. It is ther job that is being describea by means of this Airvey, 
not the population of workers. Thus, questions pertaining to age, sex, r^, religion, and marital ' ^ 
status are not usually relevant, if for some special purpose there is i neted to*obtain personal data 
via the questionnaire, then such questions should receive careful review and approval by an author- 
ity reH>onsible for and sensitive to the use of humah subjects in such ftDdies. Infomnation on edu- 
cational background^and physical handicaps falU into this need for review and approval. In some 
cases this may require that informed and voluntary consent of participartts be (Stained in writing * 
prior to administering t1|e background portion of questionnaires, to con<ply with professional or ' ' 
governmental prineipies of conduct (such as: American Psychological Assqpiation, 1973; U.S. De- 
partment of Health, Education, and Wetfara^? 1971/1974). ^ 

Equipment used or ^peratod.. In Activity B of Votum? 2 it was suggested that listings pf equip- 
ment? tools, and varioi^ob aids could fc^ simply listed in a survey questionnaire, and checked for 
use or operation separrafrom ^tasks of the job. Workers should'be asked to "check e ach i tem tftey 
operate or use in their present job^assignment.'" Supervisors, in referrjjng to a particullk^ of 
worker uoder their supervision, should be asked toV'chaek each i^m] used or operated l^ich work- 
ers." The item listings could be set up on a separate background page dnd listed with adjacent boxes, , 
mych as formatted in F igiires 4, 6, and 6/ ' ^ * 

Respondent reactioni to survey. ' In addition to background information, it is often useful to 
obtain the views of. surveys respondents orrthe per^ived merits of, the questionnaire to their " 
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BACKGROUND INFORMATION 



(Use this sheet if you are a SECRETARY, not a supervisor of secretaries) 

INSTBUCTIONS;: Pleasii^eck the box opposite the ona.item in each section that 
^ most appropriatety i;{gspribes your experience. W 



WHAT IS YOUR PRESENT JOB POSIT^IGN? (check xheone that Is most descriptive, regardless of 

« actual job title used in your agency) 

□ Admlnistntive or Genial Office 6erk 

CD Stenographer or Clerk-Stenographer 

O Medical Secretary 

CD Adminbtratjye Assistant, or Admifiittrathre Officer 

* □ Other (please write In): , 



□ Qenerai Secretary 
CT Executhre Secretary 



n] Legal Secretary 
□ Typist 
D ^ Reoaptionis^. 
Q Offwe ManagM^ 



IN 



WHAT y^DK)F ORGANIZATION OR INDUSTRY Ai^ 



YOU EMPLOYED? (checJcthe^ 
' one. most W 
appropriate) 



O Agricultural 'deduction 

Banking or Firtanea 
CZI Communicatiom / 
O 'Construction 

ff 

DiftributHM) or, Transportation of 
Goods or People 

Ediication or Training* 

' O Equipment or Vehicle Servicing 

□ Food Processing 

□ Health or Safety Services 



a Insurance 

Q Legal or Law Enforcement Services 
Q * Manufacturing of Products^ « 

JZ\ Merchandising or Sales . 

' LJ Natural Resources (other than Agriculture) 

Q Personal Servieas 

Q Utility Services (such as power, water, fuel) 

□ Other (please write in): ^ 



•INSTRUCTIONS: Please write in the boxes the nurrfber of years of work experience fpc 
each of the following questions. ' . • ' 
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HOW MANY YEARS'HAVE YOU WORKED AT YOUR PRESENT 
JOB? Renter numberr ~ . 

HOW MANY ?EARS HAVE YOU WORKED IN THE SECRETAJ^IAL 
FlfLD? (enter number) ' i 



t 



Figure 4. Example of brief badcground quettions for workers. 



INFORMATION PLAMS 



IN.WFTAT KIND OF ORGANIZATION OR INDUSTRY ARE YOU EMPLOYED? 
(cTOck the one most appi»priate) 

^gjP"* Agricultural Production 



BACKGROUND INFORMATION ' 

(\Mth\s sheet if you ar^ SUPERVISOR of secr^aries) 



INSTRUCTIONS: Please check the box opposite the one item in each section that 
most appropriately describes you*^ experience. ' CD 



V\«^T IS YOUR PRESENT JOB POSITION? (check the one that is most-descriptive, regardless of 
actual }ob title used m your agency)^ 



□ Executive Secretary ' 

□ ^hief aerk 
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^^ffice Manager, 6r Department 
^Manager 

d Head of Secretarial Services 



n Administrative Assistant or Administrative Officer 

□ Professional Worker (for example, insurance agent, 
lawyer, research psychologitt, building contractor)— 
' (please write in your job title); 



U Other (please write in): 



O Banicing or Finance 

Q Communications 

n Construction ' 

Q Distribution or Transportation of 
Goods or People 

[H Education or Training 

□ Equipment or Vehicle Servicmg^ 

□ Food ^ocessing 

□ Health or Safety Services 



□ Insurance * 

* t \ 

Lj> Legal or Lav^ Enforcement Services ^ 

♦ 

G Manufacturing of Products 

[3 MercharKlising or Sales * 

O Natural Resources (other than Agriculture) 

□ Personal Services 

n Utility Services (such as power, water, fuel) 

□ Other (please write in); ; 
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INSTRUCTIONS: Please write in the boxes the nurpbgr of years of yvork experience for 
eacTi fl^the following quee^ons. 



ABOUT HOW MANY TOTAL YEARS OfIxPER'IENCE dO YOU H^VE 
IN DIRECTLY SUPERVISING THE WORK OF GENERAL SECRE- 
TARIES? (enter number) ' ■ » 

ABOUT HOW MANY RECENT GRAOUATES OF JOB TRAINING PRO- 
GRAMS DID YOUR IMMEDIATE OR*GANIZATION HIRE LASTT YEAR, 
FOR THIS OCCUPATION? (enter /lumber) ^ 



Figure 5. Example of brief background questions for supervisors. 
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WHERE^DID YOU aECEIVE MOST OF YOUR TRAINING TO QUALIFY Jt\S' A SECRE-^ 
TAR Y? (check the one most appropriate) ' • • * [Zl 

CH Public Vocational School (secondary) 
CH Community Manpower Oevelopme.nt Program 



Sanior High School (secondary). 

Technijcal Institute or Area Vocational* 
Technical Schbol (postsecondary) 

Armed Services Technical School 

pommiinity or Julior College ^ 

Two- Year BrancyCol(ege 

Equipment Manufacturer's Training ' 
Progranv>^ 

□ On the Job (Self Leariied) 

mi Previous Work Experience in Other ^ 
Types of Jobs 



□ 

□ 
□ 



Private Business, Jrade, or Technical School 
or College 

s 

Senior College or Unhrersity 
Employer*Sponsored Training Program 
EH FormaT Apprenticeship Program ^ 



□ 



EH jCorrespondenpe Courses. 
EH Other (plea^ write in): _ 



. 9 Figure 6. Example of worker badoground question 

on prior training. ' ^ 

occupation. Such questions again should be kept briief , simple, and to the ^o\x\i-i^ Figures 7 and 
$for ex9mple$). But they can provide Valuable clues to the adequacy of the task statements, the 
questionnaire fornlat, and the scope of the occupational definition. Particularly negative views may 
suggest that the survey results are not good indicators of job performance, and the taSk information 
.rt^ay be invalid for the intended purposes. Such possibilities need to be considered,r though some- 
times they merely reflect tRe characteristics of an occupation that is in a constant State of change, 
as occurs in such fieWs as ct)mputer programming. It should also be cautioned that numerous nega- 
' tive replies are to be expected to questions on the length of the questionnaire regardless of whether 
it takes an individual 30 minutes, 3 hours, or 3 days to complete. 

STEP 10: DETERMiriE WHAT DATA SUMIVIARIES 
AND ANALYSES ARE NEED ED^ 



imary tiateqptive data. In general, depending upon the particular type of scale used and 
ses intended (per Step 7), the summary descriptive data for each task ccKild consist of such 



jm 

the anajyses 

infbfjnation as the followii^: 
V 1- Measures of central tendency or average responses (means, medians, modes). 

2. Measures of response dispersion (standard.deviations, quartile deviations). 

3. Percentage of category use. 



. MTA8UMMARICI 



* THANK^yOU t^OR YdUR COOPERATIOf^"- NOW WB WOULD LIKE 70 GET YOUB 
/R^ACTMOIJJ:* ; . ^ , , - '/ . ^ ' ^ 

This provides an'o^portbntty for you^agive'us your comments and suggestions; 
Your judgment and recomm'endalffbns witl be important ihiformatiori for our evaluation of this 
survey of job performance activritfes. Feel free to comment arany point. 

Please read each of the feven statements below. Circle the symbol on the dght which best 
describes your feelThj^ about fcch statement. These symbols are defined as follows: 

- SA > Strongly Agree ^ 

A = , Agree 

= Undecided' • 

D = ' Disagree , . 

SD = Strongly Disagree • ' . 



1 The descriptipn of the occupation being surveyed . 
seemed to include most of my present job assignment. 

2. The general form of the questionnaire seemed 
reasonably simple and easy to corhplete. 

3. I feel repsonably certam that my rating^* indicate 
fairly accurately what I do on my job. " * ^ 

4. I found it reasonably easy to think of my work in 
terrw oj, the tasks IJsted in the questionnaire. 

5. The instructions for answering the-questions aboul^K ^ 
each task '^ere reasonably clear and understandable* 

S.- The stare»Tv3ntsof the wort tasks were reasonably 
clear and accurate, at least for the ones that ar% 
part of my job. 

7. «This survey seems to be a good way to describe 
vid^t'workers do in thi; occupation. 



0' 



SA 
SA 
SA 

SA. 
SA 

SA 



U D SD 



U D'rSD 



A "U^' P SD 



SA 



A U 

A U 

■ i 

A U 

A U 



D SD 

D ' SD 



D 
D 



SD' 



SD 



Would you recommend any improven^ents or corrections for this survey C|uestionnaire? 
-Please describe. ■ ' 



Figufi?. Example of afkhngwor^ars for 
their reaction to the survey. 



r 



THANK YOU FOR YOUR COOPERATION - NOW WE WOULD LIKE TO ?ET YOUR 
REACTION: . , . 

This page provfde(3 an opportunity for you to give us your comments and suggestions. 
Your judgment and fecommendatiohs will be impj^rtant Information for our evaluation qi^ 
this survey of job performance activities. Feel-free to comnnent at any point. 

Plea.se r«ad.each of the seven s\at&ments below. Circle the symbol on the ri^ht which 
' best describes Vour feelrngs about each statement. The^.symlpols are defined as follows: 



SA = Strongly'Agree 
A 
U 

D = "Disagree. ^ 
SO^i. = Strongly Disagree 



Whdetided. ^ 

disagree. # 



1 . The descr||i;^K)j tb^occ'up^tion being surveyed wa^ 
suffic/ent to tuin'tify similar employee positions under 
my supervision in^this firm. ^ - , 

' \ ' **" 
% The general form of the questionnaire seemed reason 
ably simple and^easy to complete. * * 

.V * . • - • 
3. I feel reasonably' certain that my ratings indicate fairly 
accurately what my workers in' this occupation do on 
\ their job^ \ ^ - j 

I found it reasonably easy to 'think of ^ir work in 
terms oj'the.tasks listed in.the questionnaire. 



The instructions forlnswering the.questions at^oy^t 
each %k' were reasonably clea^Bnd understanc^£^ei*^^ 

■ ' , _ • .■ ' ^' ' • ■ #^->, : 

6, . ThfrStatements of the ^ork tasks Were reasonably 

and accurate, at least for -^^nes that are perforitiw^' - 



SA 
'SA 

SA 
SA 
SA 



U 
U 



SD 



U D SD 
U' O-vSD 
L/' D SD 



under );hy sup 



li/ 



7. This survey seems to be a good way to describe what \ 

workers (jb in this occupatiQp; = _ " SA 



saV a U , D SD 



A -v^^ ,b' SDr 



Would ydb recommend any jpiprovements or-correCtions foe this survey question^dair^?^- - 
tl6ase,describe. - " .■ - 
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Figure d:1|xaniple of asking sup^isotsJl^^r reaction to the^vey 
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DATA 



4. Percentacp of lisf^f a specified scale range. 



« 5^ Frequency Xtributions of responses on a scale«jnx! job totals. / ^ ^ 

6. Scale differences between subgroups of respondents, such as job types within an occupa- 
tional area or distinct types of respondents within one job type. 

7. Number of persons respondii^ to the question. 

Most any elementaiv statistics textbook can be used as a reference source for the appropriate descrip- 
tive measures for central tendency and dispersion of .responses, 

Selected portions of the summary infornrlattorufari be primed out by computer in formats such 
as those ittustrateclfor a s^retarial occupation in afKl A-4 in Volume 5. These particular 

tables present yaripus data for Questions 1, 2, and 3j Printouts for Question 4 would be comparable 
to the format of Table of Volume 5. The scale Values illustrated foe Question 3 are based 6(\ the 
response scales shown in Figure 12, Step 1 1 . Th^ examples are ^produced from a 1974 eight-state 
survey (Ammerman, Pratzner, & Burg^n, 1975^.' # 

Questions 1 and 2 (Task Occurrence) are summarized by calculating the percent and ffumber of 
persons positively checking a task on the survey. Group differences can be calculated and displayed 
as shown in the last column oi Table A-l (Volume 5). Other columns can be programmed to cite 
various comparisons foe various identified subgroups of respondents in which the study might be 
interested. In Table A-4 (Volume 5), which reports on an eight-irtterval scale/the mean and standard 
deviation are r^ted, along with a complete printout of the distriButioa'of responses given to each 
task. Additional columns of data note the percentiof the response^ l^iat fell within selected parts of 
the scale tsuch as categories t through 7, and categories 4 through 7, as shown in the table); 

: • • . . 

The percent rating di, task as at least a "substantial part" of the joB (categories 4 through 7 on , 
Question 3 or 4) would seem to be a useful indicator of a task's actual relevance to an ckxupation, 
sefrving to differentiate between two job'types' where Workers in both may at times perform the same 
task. The^percentage value ddes, however, tend tb correlate quite highly with the'nr)ien (average) 
scale response to Questions 3 and 4^ yielding a relationship between the two measures on the order 
of .98 or J9. Thus/etther Would be a suitable measure to use in the statistical clustering processes 
of Step TP^ . / • 

Tab^eiK>f Question 5 summary data for one occupation usual ly^splay the tasks rank-ordered 
on some measure, with associated average percent of time spent 6n feach task by workeny^^bo-said ; 
they did perform, as well as an average^ proportion of time spent by everyone surveyert4n that occM,^ 
pation. An example of this^ format is given iti Table 1, taken from a 1972 purvey in one fttisfeopolij^ 
area ^Bor&IW & Joyner, '1973). In that study tasks wer^ klentifi^ with both a duty anm tasl^affiiia- ' 
numerif cbde, as can be noted da the left column of Table 1 . Such a practice is not used inlthe pt^ 
ent procedures/ ^'v^ ^ # ^ ^ 

'. ^ / ' ^ ^ ijj ^"v. 

Data aftalyvtf intended. Analyses whjch can be performed with the descriptive task-rel^i^^i^ 
data are: % * ' . 
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*For a Single Occupation 

1 . Measiy^e of the ^nter-rater reliability on Question 3 or 4 

2. * Measure of the inter-group t:onsistency oaa question.. 
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Table 1 



Example of CODAP Prjntout Format for Question 5 Summary Data 
(from use, of Types H J, or J surveys) 



TASK JOB DESCRIPTION FOR GENERAL SECRETARY (N-23) 



CU«/qjLATIVE SUM OF AVERAGE PERCENT TIME SPENT BY^ALL MEMfl 
V AVERAGE PERCENT TIME SPENT BY ALL MEMBERS 



ERS- 



AVERAGE PERCENT TIME SPENT BY MEMBERS PERFORMING - 
. PERCENT OF M£MB€RS PERFORMING ; ^ 



O-TSIC 



^ TASK TITLE ^ 4 

CompoM coTTHpondcnct ^ 
FHf matirialt 

Typ« iddmwi on aAviloptt md/or cards 

Qytrtyptwritif ^ 
l£i(«J&tors ami foldM^ titl«f for fMt^^ilaMs) 
• CMty out Mrlttan or oral intfnictiom givan tyy amplovar 
AddraM lafiSrv and packagM 

Placa talaplUMw mamoranda^ maMagat, ate., Mhara amplovar nfiTl taa tham 

^okf and inaart lattwtjir anvalopat 

AiMmlrfa and itHilaiBMilkcatad tnatifialf 

Typa b u il na w latlart * 

Typa cartMNi copiat ' * 

1Cb^ng$ daiai on rubbar tiampt, tima ^lamp machina, and/or calandar (Mly 
Attach parti n a n t comipondanoa to ineomina maM for.ampkyyar to 
hiimamorv - ^ 

Maka corracti^fns on original and cart>on ijppiai 
Oparata copying macMna (tuch at Xarox, Thavmofax, jnalid) 
^Slgn amptoyW't maN ills aignatura) 
Edit lanwi dtetawo by amplovar 
TypamhHrtaiot raqipf of,maa tl ngi T 
HCi^p amployar rartiMa^^f angagimants, dam, thingi to do, ate. 

lii II Till III li * — - ' - * * ' * 

vvma wiorTnano lany aynami t 
Gompara copy fdrlaiijMity and nMiati^ . , ^ ^ < 
Qaanand/or tidy owh!and'amploVif'sjMaa., 
^ Arrangipapars or artidaf On your own and/or your amployar'tdatk 



Ptapara or obtain coffaa- or. lafiainma n t i fdr^amptoyar or hit guaitt 
, ProPaiir and f Ha conaipondanca 
\Typ« labala MidlvldMally 
~ Tyjaiia fkiM copy from rbu^Hlraft copy 
' Sort maiarlalt for fMing^ 

Piipart forms and corrgiponc^nca 
rtun ai lands 
PhMfiaad typwfrlttan copy j,^ 
f^slay, or rafar la laphon a calls to ano«har dspartmaot 
Claan iypMffl|w ^ ' J v 

^.TranscHba (typa) from d)9nhand pudlnas ^ ' 
QraatcaNan and/or visHora ' 
fiycb for lost masarlals in filas 

"Tv^ci^ <lndax cards, fMa eatds, "addiw fin^ar " cartti^atc J > 
extract wiQimacion from TNas 
Typg mdnnoraf^ftums 
« Opan andAor raad mail 
Plan^woA 



<100.00 
^96.66 
96.66 
96.65 
^.66 
95.66 
95j65 
95.66 
96.66 
91v30 
86.96 
86.96 
82.61 
82.61. 

82.81 . 
82.6r 
82^1 
82.61 
78.26 
78.26 
' ^.26 
78.26 
78.26 
78.26 
78.26 
^.26 
78.26 
78.26 
73.91 
73.91 
73.91 
73.91 
73.91 
73.91 
73.9r 
73.91 

.67 . 
^^7 
69.57 * 
69.67 
69.57 
'69.'67 
6p.67^ 



1.54 

1.t4-' 

1.27 

1.37 

1.77 

1.08 

^M 

1.33 

1.35 

1.25 

140 

1.47 

M9 

1.05 

' 1.11 

1.16 
^ 148 

0.78 

1.02 

1.10 
,1.20 ' 

i.ir 

0.93 
0.9fll 
1.16 
1.10 
0.95 ^ 
1.15 
1.09 
1.03 
V.09 
1.24 
0.77 . 
•1.26 
.0.95 

0. 75 

1. ^7 ' 
OM 
0B3 
0S2 
1X>2 
i*10 
t.18 
1.02 , 



1.54 

1.0fl!^ 

U21 

131 

M7 
1.28 
1.29 

' V2? 

I. 28 
'1.23 

0.87 

0.92 
OM 
t.14 
Oj65 
0.80 

oas 

OM 

Q.73 
* 0.77 
. 0.91 
0Jl6 
0.74 
0.90 
031 
0.76. 
OJO 
0.91 
0.57 
0:93 
0.71 
0.56 

II. 86 
OJI0 

.oA 

OM 
' 0.74 . 
0.>7 
•Ta.82 

. a7i 



I. ^ 

2.63 

* 3.94 
5.15 
6.84 
7.87 
935 

tff.62 

II. 92 
13.06 
14.28 
15.56 
16.79 
17.65 

18.57 

19.52 

20.67 

W.31 

22.11 * 

22.98 

23.91 

24 J3 

25.56 

2633 

27.!I4 

* 2a'io 

2a84 
29.74 
^.56 
3131 
32.12 
33,03 
33flkO 

34. ^ 
36.24 

35. to 
36M 
3731 
37.75 

u 38.^9 
?9.10 
39^ 

"40.69 
41.40 
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3. , Measure of the ffelptionship between summary response^lal3 On two task questions. 

4. 1 Identification of the degr^ to which each task is relevant to a particular occupation. 

5. Noting of large discrepancies b^e^n actual performance of workers and>erfor- 
mance expecfed by immediate supervisors. ' w 

6. Separation of nonrglevant frqm rptevant tasks for an occupation. 

7. Average number of occupationally relevant tasks performed by any one worker. 

8. ; Average number of occupationally relent tasks cited as expected of workers by 

any one im^mediatp superior. 

9. Generation of a composite job description, based upon: » 

1 - ** 

a. Most commonly perform^d tasks, 
- .(or) " . 

b. Tasks which are, on the average, the^most significant part of the job. , 
• ' ' ^ ^ \ 

id. • ' Review ofxortim^nts anc|*3uggestions give>i by questionnaire' respondents. 



For an Area Ct^taining Several Clusters of Job T^fm 

J . Qustering of worker respondents into job ty^, bakid upon a selected measure of 
commonality of task performance. ^ * / ' , 

- ^ Noting of variation in worker back^'Rjnds for dach job tyfie. \ 

3^ Noting of tasks most reprBsentatiyeTof a job cluster, or distinguishing one job typ? 
' ' from inother. 

4. Each of the analyses tthrough 9 above for ^h specific job type. ^ ^ 



JIuidelines for doing these analyses are given in Step 2D of this volume. Those essential to the 
intended study should be selected and recorded prior to.conducting the renwinder of thfe study. 
They serye as a firm reminder in the next step, Step^ 11, of ivhat nmj«t be included in the survey de^ 
sign to accommodate th6se analyses. Where fiarticular worker charactA-istics or employment-set- 
tings are to be compared, these should be identified and appropriate background information built 
into the survey plan or res(S||ndent background questions. ^ ^ 

STEP 11: DESIGN SURVEY AND rrS 
ADMINISTRATION ' * 

Thif step involves the putting together of instructions and answer sheets for^ach question to 
used, compiling these into questionnaire booklets for each re^>ondent group, and determining 
the number and distribution necessary for each booklet. Each is discussed in turn beJow. 

— ^ Quattionnf ire format And forms. Task statements* apd questions are combined to form one 
. Task Inventory duestlonnaire (TIQ) booklet for eachsafected group ofVespondents. Thus, for ad- 
* ministering q{iestionnaire Type A, two distinct foms <n TIQ booklets wo^jd be needed. Each 
would contain ^e same comprehensive list of taskTdeVelopecJ in Steps 2-6 of Activity C (Volume 2). 
Associated with the task list in each form of I'lQ bookla would be the instructi^ons and answer see' 
^pns Jor thequestion^ appropriate to that booklet, as ndt^ previously in Figures 2 and 3. 
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Suggested instructions and answer seqtion formats for Questions 1 through 5 are given in 
Figures 9, 10; 11,12; 14, 1)S,^^an^ 16* 4Kan be seen on the figures of the answer sections that 
TiQ respondents Simply plaoB their answers to the right of each task statement* When Question 1 
or 2 is used along with a second qqi^ion, both can be located down the* ht.side of the task fists, 
as shOMm in Figuce 16 for.Question 5* The reader is cautioned thatthe tasks listed in th^e figures . 
do not necessarily reflect good quality statements in accordance with Volume 2 guidelines, but are 
^ merely illUstratife of the format* , 

When answter section space is not available for all questions to be asked of one respondent 
group, such as wUI be required in Volurpe 4, then a separiate answer bodklet can be developed to 
accompany a booklet listing the tasks. This will be explained further in Volume 4. For use of 
relevancyTypes A*J there 4S no need for an answer |;K>oklet bound separately from the task listing. 

/ y *- * 

' Instructions to respondents should specifically cite the occupation that is bein^studied. The 
imentis to make' the material directly relevant to the respondents. Do not address them only In 
such general terms as "workers" or "employees." 

^ Directions also should ask respondents to write ia any tasks which are relevant but not listed, 
^ though these need not be rated on the task questions. This write-in r^uest is one rea^ why each 
respondent should have all task s^tements, not some fragment of the list. To emptpy Question 5 
, in a survey, it is absolutely necessary for a. worker to rate ait-tasks. Failure to do so m^eilt impos- 
sible to calculate a measure 9f relative proportion of time spent on each task (see Step 18). 

Answer sections shouki strive to provide the quickest and easiest way for people to answer the 
questions accurately* It is for this reason that in Figure 14 each afternative category made avail- - 
able: the respondent needs only to circle his answer. In Figure 1 1 only a simple checkmark ;is 
galled for. Figure 16 illifstrates an alternative where a numbertnust be vi^ritten in by the respondent. 
This is a bit more^ demand iry of the respondent, and leixls itself to pfoblems of legibility, but rt has 
been used succ^ulty in maHy ocQupational surveys when ^^bry large numbers of peopledre usdcf. 

*At the top of each ansjier-section cfohjmn ^ould be a brief reminder'bf how to indicate the 
answer or rating, including a brief ktfy to any scale levels for the question. This should be repeated 
at the tpf^ of each page of the booklet listing the task statements. ^ 

In an extreme circumstance the list of tasks might be broken up with different statements ap- 
pearing on two or three subforms* Such a need can possibly arise when perhaps 2,000 tasks ate^in 
the list and it is known that t^ fespondents d>solutely cannot have sufficient time to answer for 
all.taslcs. Divkiing the list by alteijiately selecting every second'or third^tement for a separate 
s^bform would be possible for Questions 1 through 4, but only. when a lar&6 number of persops-are 
available to answer each subform. It is not recommend^ that the^ist be divided by duty oat^ries, 
with each sui)form l^isting different duties of the job. 
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QUESTION #1 - 'Task Occurrence" 

DiKaCTldNS FOV REPORTING WmCH ACTIVITIES 
• \0U PERFORM ON YOgR PRESENT JOB ' 

(Pfease read this page car^lly arxi completetyj 



1, During, the lastiyear or so in your present Job f)o^ , 
which of the activities in the List of Activities have you performed? Place 9 check mark 
< or "X" in the column to the right of each activity statemerit to indicate Which* tasks you - 
have actually t>een doing. Task 9ctivities not performed by you should be left blank. 

2, , /Be sure to read every activity listed. Do not depend on the duty labels that are used to 
group the activities. These ^uty^tegori^ are not definite. They may contain some of 
your job activities, even when you do not^nerally perform the duty itself.^ 
' ^ \ • • ' r ^ • . 

3. Do//ic/a(feaspartof yourjpb: ' # 

aik Recept work experiences as a Business Data Programmer in other offices of your 

^present firm, but not for other ejT\pliE)yer$. 
b. Performance of an activity not ndrn>ally,done by^you, but that you did do at least 

^ once as Zart of your job, eyen if it was in a very special or unusual circumstance. 

4. Do rfot mark activities: / • ^ , - " ' 

f. Dbnc^ bn\Y^»rif(Sn\ou were emp|p)(ed in some other job position (such as Junior 
Programmer, Engineerirt^ apd^ierft^c Programmer, or Systems Analyst). 
, b. * If you occasionally ^'assM^someone to do ti)^ activj^. but you are not too 

^^atly invoh^ed in th^^erformance. H(*eyer, if you handled a significant portion 
of the activity (^ynly you can be the judge of that), th^ bccasion n>ay be counted. 
« c. K they are aotually^rformed by an assistant assigned to you, and not by ^u. 

5., In answering this question of y^ich activities ybu actually perform, pay particuMr atten- 
tion to itbq "action verb." The "action verb" is Cisually th^irst word of each statement. 
Do /?of indicate pecfQrmance of activities^done by a subordinate and only supervised by 
. you, unle^ the "action verb" i^gj^es such supavision as a part of the activity. 

6. The pa^ of the Task Inventory booklet should not be removed when ar^wering this 
- . question; they will need to be in proper sequence later to proce«f your answers along 
with those of Other people ^viswering this question. 

^ ' NOW TURN TO PAGE 1 OE THE ACTIVITIES LIST, 
AND BEGIN MAl^KiNG YOUR ACTIVITIES IN THE BOXES PROVIDED. ^ ^ 

I 

Thank you for your participation in this study. ^ 

- 

' Figure 9. Instruction sheet for Question 1 <workanK 
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QUESTION #2^ 'Talk Occurrence" ' 

DIRECTIONS FdR REPORTING WHICH ACTIVITIES 
' SHOULD BE PBPFOR^ED AS PART OF THE JOB 

' * 

(Pleaie read this page carefuHy and completely) 



1/ ^rom your experience as a sup^isor of one or rnore Business Data Programmers, indicate whtck of the 
activities in the List of Activities should be performed by Business Data Prdgrammen in your operation; 
that is, by such emplo9i||p urKier your supervision in your office or firm. Ptoceacheck mark or "X" in 
the column to the Hght.of eac^ activity statement to indicate which taslcs your Business' Data Program- 
mea should be doing as pert their job, even if only done once. Task activities not pact of the iob for 
any of your Business Data Programmers should be left blank. 

L . * " , . ' ^ 

2. Ba sure to read every activity listed. Do not depend on the duty labels th«tt are used to group the activ- 
ities. These dut/ categories are not definite. They may contain some relevant job activities, even when 
the duty itself is not^generally performed. - ^ 

3. Oa//ic/adleaspartof theiob: 

< a <^ . * 

a. Activities that your programmers ocaasionally are expected to do, but that are not normally 
part of meir iob. * ^ 

b. Activitis that are to bejierformed by only one of your staff of Business Data Programmers, 
even if tf ey are not part oi^very programmer's job. 

« • « 

4. , Do not mark activities: "-^ 

a. If done oniy by other types of job positions is your office (such as Junior Programmers, 
Eng^neeringandSciefni^PicP^ograrmners, or Systerns Analysts). ' * 

b. JUyouf Business Data Programmers only lend occasional a»istance to apother'Worker^performing 

a task« and are not responsible for the effective performanpe of that task. 

5. Do not rate your own job; rate only th6 work of' programmers you supervise. 

6. In answering this question of which activities should be performed by a Business Data Programmer in 
your office, pay particular titentjon to the "action verb." The "action verb" is usually the first word 
of each statement. Donor indicate performancerof activities done by a helper or other worker that is 
supervised by. a Business Data Progr^mer, unhu the "ac^ton-verfo" implies such supervision as a pert 

r of tfie programmer's activity., > 

i. The pages of the task Inventory booklet shoukj not be removed when answering this question; they 
will need toHM in proper sequence later to process your answers along with thbse of other people an- 
swering this questk>n. * ' ' ^ 

NOWTurfN TO PAGE 1 OF THE ACTIVITIES LIST, * 
- AND BEGIN MARK4MG THE RELEVANT ACTIVITIES m THE BOXES PROVIDED. 



Thank you for yoor participation in this study. 
Figure 10. Instruction sheet for Question 2 (supervisors) . * \ 



V 



32 



33 















i 




STE^TIiSURVr 
DESIGN PLAN 
















LIST OF ACTIVITIES 


• 
















% For Business Data ||pgraitimers 










(Activities are grouped under 12 general duty areas) 
• 








DUTY A: SYSTEM ORGANIZING AND PLANNING ACTIVITIES ' ^ 

V 


LrnCwl\ 11, .1 

<^ if part of iob 






1. 


Analyze company operations to determine where most significant*, 
improvements can be made. 


□ 1 






2. 


Analyze data processed for possible modification and combination 
pf reports. 


□ 2 ' 






3. 


Analyze data processed to make sure that desired information 
is obtained. 


□ 3 ' 




• — 

4 


4. 


Analyze documentatioa^for completeness and acctJracy for data * 
processino ooerations and control 


1 1 A 0 






6. 


Analvze functional area rpnorts for format prror^ 

• 


□ 5 




• 


• 6. 


Balance and correct reports. 


1 — 1 c 
1 1 0 






7. 


Brief sup^isor and staW^ • * . 


1 1 / 






8. 


Conduct on-the-job training for data services personnel. 


8 




1 


9. 


Coordinate work of d^ta services unit with activities furnishing 
l^eport data. ' ^ ' 


j 9 






10 


butnaaras ano raciors ipr use in monagemeni coniroi 
systems. . • • * 


1 1 in 


J ^ 




It. 


Establish data services production controls and standards. <^ 


LJ 1 1 


• 




1 


Evaluate work performance of data servkes personnel; 


• 








Fill out questionnaire inventory forms. * - 








14. 


Inspect methods used to process data. 


□ 14 ■ 






15. 


9rient newly assigned data services persoxin^l. ^ * 


• □ 15 


^ 






Figure 11. Answer sectbn format ^or Questions 1 and 2. \ 
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QUESTION #3 - "Exttnt Taik b Part off th« Position" 

DIRECTiONS FOR REPORTINaHOW MUCH EACH 
TASMS A PART OF YOUR JOB 

^ (Ptease read these pages carefully and completeiy) 



Anmm this question to ei to give the best devriptlon you can of what youtfc) in your present job as a Business Data 
Proy e nnmer. For each task tteiement in the Ust of Activities consider how ^gnifkant a part of your job H is. This • 
may be done in two steps: 

First, consider vvhether tha acthfity is a of your job. If your ahswar is NO, then the task item is 
defmitaly not pert of your position. ^ 

' Second, and only if the item does apply to your job, decide how stfiiificant a part of your position 
hi 



Be sure to rae4 every ^tivityllsM. Do not dspend on 'ths duty labels that ariL used to group the activities. The^duty 
eetegories are not daf inite. They may contain some of your job activities, even when you do not generally perform the 
duty itself. ^ 

&rch the appropriate answer to the right of each activity statement. Please make a rating for every item listed in the 
booklet. ' 

Fpr each item, choose a value b et¥ ^ n 0 and 1 according to tha following ratingscale: 

0 • Djif intte^ nor a of n*f PesHnn, does not apph(« or ia not true for this*!^ > 

1 » Under unusual eircumauneas may bee /nwior pert of my |flb. 
2 

3 

4 « Asfi6<tanris/paftof myjob. ^ > ^ 

7 * ^fCrnost significant part o# my job. • 

Use ail eight tcele vatuei, as appropriate. The ratings of "2" and "3" represent intermediate levels between "MINOR"*' 
and "SUBSTANTIAL" pertrof the Job. Similarty, the ratings of "5" an4 "6" reprewnt intermediate levels between |i 
"SUBSTANTIAL" and "MOST SIGNIFICANT" parts of the-lob. Thus, the scale represents a series of incrAsingiy 
higher lewis of the^xtem to whnh a task is oonsiderad pdrt of the job. Your rating of a task might be at any one of 



5^ . If the activity statement does daacriba^ona pert of your job, theyvconsider and weif^ all of the f bllowing factors 




a. Its irr0Qnanc0 (that is, its contribution to effective operations in your off i^or firm) - . ^\ 

b. Its /^pguency of occurrence (thet is how often you do it). ' • - 
c Its ralavanca (that is, how appropriate or pertinent it is to your Up asstywnent). 

d. And, any other f ector which you think determines to whet axtert^UMk is part ofy^r p^itt^ ^ 

Hfyour own'^mind,f ombine these fectors into a^inv^e'ra^'ng of how signt!|iant apart oi y^r job it reiMeaeats,')isir>g 
a value from 1 through 7 to represent ydbr comt>ined rating. Th9ncin:h that yalua opposite the activity^taiaioeftt 

If the statement descMbes an activity that doeenot spply to, or is nor true for your mi^^mKcM9 l3ha J^i^te0orY « 
on the anewsr scale. This a n s wer elsoshould be used foe any activi|ies done entlreW by a s^bord4l||^^M^tM; helper, 
or treineayou mey supervise. In conskiering whether en activity is actuaHy patLsA^our job, pey peH^coltMmntion 
to tfie "ectkwi verb " The "ectton verb" is usually the first word of eech stetem^nt. If an ecthrity is supetVisad but not 
performed by you, do not count it as pert of your job unlaa the "actkwi verb"/lmplies sudh supervision es part of doing 
theectivitV. 



EXAMPLES: 

a. ,To Indicate an activity that is a substantial part of your job, cir^ the 

p \l 2 3 (4) 5*6 7 

b. To if«lkcate an activity that is a considerable pert of your job, having f|»aJor sigi^teance^ pro^sWy^la the 6j 

'0 1 2 3 4. 5 © 7_ ' \ 

The peass of the Task Inventory booklet Bho6kJ nbt be rentoved when answering this question; they wiN need to be in 
Liequenee ^ter to process your e ns wey s along wi^th thoee of other people ensvwring this question. 




onioacsi 



Thanlc^ou for your participation in this study.* 



Figurt 12. InstruHibn^fhaet foi^ Quetttori 3 (worken). 




STEP 11: SURVEY 
DESIQN PLANS 



3- 
4. 



QUESTION #4)- "Extent Task Is Part of the Job" 

DIRECTIjdNSH^R REPORTING HOW MUCH EACH 
TASK IS A PART OF THE JOB 

(Please read these pages carefully and compie^ely) 



Antwer this qutitton so as to give the best description you can of wh'at Business Data Programmers do in your operation; 
that is by such employeei under your supervision m vour office or firm. Rk each task statement in t^e Ust pf ActivKte» 
consider how significant a part of their j6b it is. This may be done in two stepi r 

First, consider whjpther the activity should be performed by them in your operation. If your answer is NO, 
then the task item ts deftrfitely not part of their expected work Assignments. This woukl ir>clude activities 
don^pff^Y by other types of job positions in your office (such as Junior Programmers, Engineering and 
Scientific Programmers, or Systems Analysts! ^ ' ' ^ 



signiffcant a part\f their /ob it 




^ Second, and only if the item does apply to your programmers, deci 
repreeenU. 

Be sure to read every activity listed: Do no( depend qp the duty labels that are used to group t^e activities. These duty 
categories are not definite. They may contain some of their job activities, even v^hen they doinot generally perform the 
doty itself. 

Circ/e the appropriate^answer^to the right of each activity statement. t*lease matce a ra^lng for every item listed 
For each item, choose a value between 0 and 7 according to ihe followir>g rating scale' 




klet. 



Definitely not a part of their job, doef not apply, or isjibt true for this job 
Under unusual circumstancei may be a mmor pa/Y of thetr Job. 



0 
1 
2 
3 

4 - A subnantial part of their fob. 
5 




A most significant part of their job. • , 

\Jm all eight scale valoes, as appropriate. The ratings of "2" an«l "T' represent intermediate levels between "MINOR" 
and "SUBSTANTIA L" pertt of the job. Similarly, the ratings of ^[f" anfl "6^' represent intermediate levels between 
"SUBSTANTIAL" and "MOST SIGNIFICANT" parts of the Job. Thus, the scale representt a series of increasingly 
higher levels of the extent to which a task is considered part of the )ob. Your rating of a task migAt be at any one of 
these lav^ls. 

5. If the activity stat^nent does describe one part of their )ob, then consider* and weigh a// of the following fact;pr$ 

a. Its importance (that is, its contribution to effective operations in your office-or firm) 

b. Itt frequency of occurrence (that is, how often a programmer does it). ' . 

c. * iu relmence (that ts, how appropriate dvperttnent it is to their job assignment). 

*^ d. And, Jny other factor which you think determines to what extent the task is part of their job, 

in your own n/ind, combine these factors into a singte rating of how significant a part of 'the job it represents, using a 
value from 1 jmrou^ 7 to represent your combined rating. Then circ/e that value opposite the activity statement. 

If the statement describes an activity that does not apply to, oris not true f«r the job, then circ/e the "0" category on 
the antwr,scale. This answer also should be used for any activities done entirely by their subordinates, assistants, helpers, 
or trainees that flliv may supervise. In considering whether an, activity is actually part oi the job, p^V particular attention / 
to the "actibn verb." The "action verb" is usually the first v(rord of each statement. If an activity is supervised but not 
performed by them, do not count it as part of.their {ob un/ess the "action verb" iq\pim such supervision as part of ^ng 
theacth/ity^ , , ' 

Do not rate your own |0b; rate only the work of programmers you supeQcise. 
EXAMPLES: f ^ 

a. To indicate an activity that is a sutMtantlal part of the fob, circle 4: 



6. 



h 



1 



6. 




b. To indicate ar>.activity that is ^considerable pa'rrof the |ob, having major signrfk^nce, probably circle t^e 6: 
0 12 3 

The pages of the Task Inventory booklet should not be removed when answering this question; they will need^o be in 
proper sequence later to process your /nsv^rs along with those of other people answering this quesflon . • 

Thank you for your participation in ttiis study. 



Figure 13. Instruction shept for Question 4 (supervisors). 
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LIST OF ACTIVITIES 
For Business Data Programmers 

I Activities are grouped^inder 12 general duty areas) 



Key to abbreviatfons 



0 r ' Definitely not a part of my job , 

1 = ^ Under unusual circumstances may. be a'mmorpart of my job 



2 
3 
4 

^5 
. 6 

7 



A substantial part of my job 



A most significant part of my job » 
DUTY A: SYSTEM ORGANIZINO AND PLANNING ACTIVITIES ' . Circle ope category for each item. 

1 .• Ari^fyz^ company operatrons to determine wHfere most ^ 
significant improvements can be made ' , 

2. Analyze data processed fbx possible modification and 
y cdmjaination of reports. * 

3. Ah^lyze^Ata processed to make sure that desired 
intbrmation is obtained * 

4. Analyze documentation for completeness and accuracy 
for data proce^ing operations and conlroi. 

5. /Kndikfze functional area reports for format errors, 

6. Bai^pce and correct reports. 

7. Brief supervisor and staff. 

8. Cohduct on-t>)e-joi) training for data services 
peicsonnel. 



Coor^iinate work of data services unxt with activities 
furnishing report data 



10. Develop standards and factors for Use in management 
control systems. 

1 1 . Establish data services production controls and 
st^ards. ^ ; 

12. Evaluate work performance of data services 
personnel^ 

13. Fill out questionnaire inventory forn^. 

14. Inspect methods used to process data. 

15. Orient newly assigned data services persoYinel. 



0 ^ 1 


2 


3 


4 


5 


6 


• 


* • 










0 1 ✓ 


2 


3 


4 


5 


6 


0 . .1 


2 


3 


4 


5 


5 


4 












0 1 


2 


3 


. 4 




6 


e 1 


2 


3 


4 


5 


6 


0 1 


2 , 


3 


4 


5 


6 


0 1 


2 


3 


4 


5 


6 


0 1 


2 


3 


4 


5 


6 


0 1 


2 


3 


4^ 




6 














0 1 




4 


5 


6 














0 1 


2 


.3 


^ 4 


5 


6 


0 1 


2 


3 


4 


5 


6 














0 * 1 


2 


3 


4 . 


5 


6 


0 1 


2 


3 


4 


5 


6 


d 1 


2 


3 


4- 


5 


i 


) / 



Figure 14. Answer section format for QUestidn 3. 
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STEP11:SURVE1 
DESIGN PLAM 



\y INSTRUCTIONS/OR COMPLETING TASK INVEfSITORY 

Carefully read each of the Task Statements and place a check mark {✓) in the column labeled Check 
for each taSk whiph you perform on your present job. 

After checking alt tasks which you perform, th^n rate only the task you^have checked by placing^ 
number '1, 2, 3, 4, 5, 6/ or 7 in the column labeled Time Spe/7f which most closely gstjmates the 
amount of ti/ne you spend in performing the task. 

Time Spent means the total time you spend on each task you are rating, compared with the time 
you spend on each of the 'other tasks you d<). * ^ ^ 

At the bottom oh any page, write in and rate any tasks you do which are not listed. - 

EXAMPLE: ' - 



DATA PROCESSING TASK INVENTORY. \ 


Paqe of Paoes 


LISTED BELOW ARE A DUTY AND THE TASKS WHICH 
IT-INCLUDES. CHECK ALL TASKS WHICH YOU PER- 
FORM. ADD ANY TASKS YOU DO WHICH ARE NOT 
LISTED, THEN RATE THE TASKS YOU HAVE CHECKED. 


CHECK 


TIME SPENT 


V 

If 

Done 


1 . Very Much Belovy Average 

2. Below Average 

3. Slightly Betow Average 
4 About Average 

5. Slightly Above Average 

6. Above Average 

7. Very Much Above AWrage 


'- » 
K. PROGRAMMING COMPUTERS 


1. Adapt programs written tn symboticlanguage to 
different conrtputfff configurations. 


V 


H. 


t2. Analyze applications tb select appropriate utility 
programs and subroutines. 


V 




^ ' 3. Analyze computeit inputs prior to test run and 
follow-up. 


V 


1 


> ^ 

4. Analyse programfning documentation. 






^5. Audit computer inputs»after test run and 
follow-up. 




c 


6. Code computer appliqations using a reports 
program generator. 




m 








* 

Piguiie 15. Instruction sheet for 
Question 5 (workers). 

* \ * 
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^ DATA PROCESSING TASK INVENTORY ^ ^ Page J^Lof P\ge% 


LISTED BELOW ARE A DUTY AND'TH€ TASK$*WHICH IT 
INCLUDES. CHECK ALL TASKS WHICH YOU PERFORM. 
ADO ANY TASKS YOU DO WHl£H ARE NOT LISTED, 
THEN RATE THE TASKS YOU HAVE CHECKED.\^ 


CHECK 


. TIME SP^NT ^ 


4 

V 

If 
Done 


1 . Vtry Much Beto)^ Average 
2 BeloMi Ai/nrMM 

3. Slightly Below Average ' ' 

4. About Average 

5 Sliohtiv Ahovto AiMraM 

6. Above Average ^ 

7. • Very Much Above Average 


— ' — ' : ^ 

H. OPERATING AUTOMATIC DATA PROCESSl>*G EQUIPMENT 

* 

- : > 


1. Analyze job steps to determine data recovery points. 


- 




2. Analyze machine operation through use of messages^ ' 

iTtf^^Aiuan TrAm lino A^iiinmAnt 

i^cvivci] iiom Tne ct^uipmcni. 


i 




^ A.fi2il\/7A miU*KirvP nnArati/\n tKmiinh ^ico /\f o/tn<^iti/\nc 

«J. ^VKiiy^V IIJO^IIIIIC Ul^ClaimM illlUU\|ll use \J% l/l/IIUIllUM9t 

• displayed.. 




J ' 


4. Determine cause of machine stops and malfunctions. 






5. Interrogate memory locatjpns on the consol% 






6. Load programs and data cards. 






7. Locate tapes m storage media or tape library. ^ ~ 






O. IVidinidin CaiU TilcS (SOUrCv OUjcCl, cIC./. ^ 






«f. nflainiain current run tapes. 




- 


p ^ • ' 

>ivi0inidiTi levels OT cMiia processing supplies. 






1 1. Maintain technical files on equipment operation and* % 
procedural changed. * " ^ 




• 


12.^ Make switch settings. 






13. Operate card r^der. ^ • 




i 


t4. Operate collajor. ' 






15. Operate console. 






16. • Operate decollator. 






17. Operate document writer. 






' 18. Operate forms bursting equiprnent. 






19. . Operate interpreter. 






20. Operate key punch machines or verifiers. 






--44^oOperate mgnetic tape unit. ^ 






V^v ^ — — ' 

22^ Opiralerpaper tape punch and reader. 



















•Figure 16.. Answer section format for Question 5. 
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STEP 11: SURVEY 
DESIGN PLANI 



r 



Dev^p plan for selecting respondents. Plans for the kinds and numbers of persons to be ad- 
fnini||ered the survey form shoulct specify three items of information : 

1. T Number of persons needed for each group or set of TIQ bool<lets. 

' ' V ■ • ■ 

'2. Background distribution of respondents within the defined scope of interest. 

- * f 

3. Occupational and situational distribution of respondents, consistent with the defined 
scope of interest. 

.8 f 

For a single prescribed occupation, at a minimum (regardless of the sel^tion plan), there should 
> be ^ least 30 usable questionnaires returned per worker group and at least 30 usable questionnaires 
returned per supervisor group. [Fifty (50) rs a far {^referable minimum', but it isTealjzed that^uch a. 
nurhber may be difficult to acNeve in all circumstances.] This number is necessary' to assure adequate 
stability of the summary data. These minimum group sizes also are appropriate for any prescribed 
subgroup of respondents for which special surftmaries are desired in the study. 

I^ore desirably, up to 50% of workers in a small occupation, or «it least 500 workers in larger * 
occupations,- are syitable goals fbr occupational perforjnance surveys. These numbers lerKi greater 
assurance that all meaningful performance situations will be adequately represented in the question- 
naire data. Such numbers are quite feasible for surveys (a) within a large employing organization, 
(b) across the membership of a cooperating professional or. labor association, or (c) whenever^com- ^ 
pensatoiry payment to each resporKleht and/or employer is unnecessary. * ^ . ^ 

For a cluster of fobs in an occupational area, such as'when specific job types ^xevpi knoyvn for * 
certain, or cannot' readily be identified with particular workers, then the minimum numbecs of re- 
spondents is increased. If the job types and the workers in each arp known with reasonable.certainty, 
usable returns from.at Teast 30^ workers and 30 supervisors for eaqh likely job type are needed. If such . 
job types and their incumbent'workers are highly uncertain, then surveys from about 500 workers 
across the ofccupationa^rea would generally be needed to yield effective job clusters in Step' 18. 

'More complete representation of an occupational area usually involves up to several thousands 
of those employee .n the area. Descriptive summaries can be fjerfornxed^with no methodological ^ 
limit on the numbe. of respondeats, the real limiting factor being the gxpense of keypunching the ^ 
responses for computer processing of the data. For job clustering appli Ations, howevej*, the number ^ 
of persons surveyed should be limited to the capacity of the available computer clustering or factor- 
ing program. Usual hand-calculated clustering techniques^can reasonably handle only up to aboiO 
20 or 30 respondents, factor analysis programs about 1^0 to 180, and the Air Force's C<l|ARclus- 
tering accommodates up to 2,000. * » > •.- 

The technkjues^itb very limited capacity are usefulVor identifying perhaps three or four spe- 
cialty areas that may be emerging within a single occupaticui. They are not very effective in broad ' 
surveys of an occupational area which includes a range of occupations.and many specialty areas. \ ^ - 

^ When seeking minimum numbers of usable questionnaire ^iflarns the administratiort of tt^'sur- 
vey must be kept tightly corttrolled. Respondents and/or their supervisors must be individually coq-'^ 



^ vey must De kept tigntiy controiiea. MespotKients ana/or ineir supervisors musi ue inuiviuuduy i;u 
^ ^acted and direct follbw-up conducted as necessary to Wure cortipleted tjuestionnaires- A1$o', 

additional 15 to 25% of questionnaires per group should be administered to allow for losses tha^an 

be anticipated due to faulty responses or failurt to respond. »^ 

Techniques for adn^inistering surveys .to assure high usable return wte^are discussed ulwJer v 
Activity t, and particularly at Step T3. , ^ * 
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To encourage h full repre$er\|ation of the defined scope Qf occupation^ ilhterest in the^maller 
sample S|irveys, it is useful to place sonneconstraints upon the types bf itKi{vidual$ and of employ* 
nn«nt9^ngstoKbe involved. Length of job experience, individual job assi^rneht, geographic loca- 
^qn^si^eof local work unit, and type of employing agency or firm se^jh to be the most cruci^ fac- 
tors to contrd In most surveys (thpugh special purposes of a study mtf^ dBquJre control of other ^ 
factors)/ ^ t ' ; t • ' 

Worker^nd supervisor factorscan be sp^ifiod on the directions given to those persons who will 
be^making thjB direct contacts^th^indivickjals and/or thei^^ < ' 

Figjjre 17 portrays one such <fet of admirrtstrator instructions; Note that it defines the 00:11- 
pation of inter^iber Step 1), including specialty areas that may or may not be included. 

• The desired number and types of employiMnt settings for many surveys can often be dis- 
-played quite%imply by a matrix and an outlinnbip. Fpr example, workers in tbe following pro 
portions mt^t be.sough| overajl and withfn ea^g^ographical divisi6n used in the study: ^ 



( 



Type of Employing Agency or Firm 
Public JPrvice ^gency Priva^ Business 



Public Jw^i 
(govmher 



ent, education) and industry 



Si2;e*f 

L'ooa^ 

WoHTO 



nit 



Small Operation (less^han 
15 workers in the job area) 

Large Operation (20 or more 
w0i;kers in the jbb area) ' 



2^% i'- 


^ \2b% 


* '5 1 


• •:.2S% 

* * • 



45% of 

QfOOp 



55% Of 
grouf^ 



50%. of group 



50% of gr,94jp- 



i The proportions'can betransjated into actusfl nuijibers when the total.number to be surveyed is de- ^ 
' cided. This prevertts^ local administrators .from acquiring a predbminilfTC of one type on the basis of 
ease of local'access to workers. If commumty population density (such^as rtiral, small town, major 
metropol^n area) is eriso of concern, then designation of such can be addM to these requirements. « 

' Geographic distribution naticmjilly might be portrayed^simply as follows^Kh equa^p|esen- 
tation from each regional divisions qiv^a'reasohabteTepresentation of geo-economic area across 
th% nation. One or more localities in^pcn jrl^gion be used for contacting workers §ind super- 
visors, ^milar depiqtions could be made*^ reQibnW or statewide; areas, when the ^ntent of the sOr* 
»veyiQOpe is less than.national. . J 




STEP t1: SURVEY 
DESIGN PLAM 



: / 




. DIRECTIONS FOR IDENTIFYING EMPLOYEES- 
- . t6bE ASKED TO COMPLETE A QUESTIONNAIRE ON . 
THE TASKS OF AUTOMOTIVE MECHANICS . 

. ■ « ' .' 

.Workers selected to^swer the TrTslTTriVeotory Q6estionnaire should be employed full-tirtie as 
Automotive Mechanics. They shcoild preJ^ratJy have at least four but not more than, 10 years 
of work jijcperience as an /^tomotiyej^^hanic. Though a few are acceptable, try to avoids ^ . , 
those with , very little fob e)ipertetK:r6r the very senior workers in the occupation. ^Jt 

An A^omotive Mechanic is one v\^o repairs and overhauls automobile light buses, light trucks,* 
and oti^er automotive vehicl^es^. They may diagn ose da mage or malfunctions,>emove,an(i replace 
\units, disa^mble and inspect parts for^wearand^emcing; overhaul units, rebuild parts, rewire 
electrical systemi5,7eline or adjust units. They do not typically njend dam^iged'body and fenfJers, 
nor install or repair accessories such ds radios^TKey may become specialists in one area of^uto- 
mobiler^ir Wuch as transmissiqas, engine tune-upror brake repair) but must possess Jjdneral 
Skills listeq above. mC 

wo/kers may use such other job tj^fc^i Auto Michanic, Automobile Repaicm«i, Garage 
Mechanid, or E»%ine-Repair Mechanic. iWugh qualified in general autooiojive mesj^^nics, their 
immediate job asiignn^ep^t could be lirnited to particular jrepair functions such as carburetors, 
fropt-en4, differentia! repair, or tune-up. , - 

Workers should'rjor be selectW who dre (a) less than fulMledged metehanic ^ 
or islstants; (b) speciali ju in ntinautomotive or peripheral systert^s, sucfftp ^ 
# • diesel truck engines', f arflfwuipmeat, or motorcycle^; (c) limited irt^quali/icm 
J'^ area such a^ body nepair, electrical.systems; sitt^ice station mechanicpr 3ir 
(dVsupervisors'or service managers. J 

2. sjpervisors of Automotive Mechanics selected taanswec t^e Ta'sk Inventory Questionfejre 

sTOvjld be those ppr^ons yvhag|p3ani|ationally *are tbGated immediately gbove the type of worker 
> described for this study. Th^ need not be the immediate supervisor of the' particular Workers 
selected, but should normally supervise the Wk of that type of wbrker. It^s preferred that 
jhey 'have at least^ouP years of recg»t^xpenence supervising a number of Aut6rno^ Mechan; 

' . ' ' " . ^ . ■ ' 

These f'^sons supervise and coordinate^th^b activities of*i^tpmotive Medaanics engaged in. ^ 
repairing, adjusting, servicirig. and storing fnoiiDr -vehicles. They may inspect'^nd drive repaired 



c^H^ 

lir conartio 



repai^elfters 
trial trwkS, w 
one specialty^ 

itlohing; and 



re|Jdn iiiy, ««jjuaimy, 3CI viujiiy, aii« -'w'"w.w-. . — f i • - . 

vehiclfes to ve«;;fy repairs, schedule the trans^>6rtyng of materials to service or storage ar^asl 
study repair scljiedules and estimate time/cost requirerrients^ make work assignments to vwrl^rs, 
analyze and revive woYk problems, recommend or initiate pier^nnel actions, and sirnilar smH^^* 
visory activities:* * " ' . 

\ These supervisors may have such job titles atf Service Manager ,.Garihe Owner, Repair Sho^^ , 
' MafVoe'r^ Service Advisor, Shop Foremafi, or Chief Mechanic. ^ / ' * ^ 



S 



* Nill'^^' Example of inslructiQps to ^IQ 
^ •'"^minirtraters regarding tholcinds * 

' -\ df persons to be select^ for the ^ 
$urv9f . * . 
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For studies by public schpohsystems lo deriye training currlculuntcbntent^jacent statesx 
should be included in the survey if statewide rather t|ian national geographic scope is intended. N 
.This would Help ass44Fe that stuifltents becortieprepafred for effective ertiployment in the fulf labor 

* "^"^^^^ which they are likely to find their oppprtunitiesA Wit^* mobility trepds b^ng what 

• ^^»fmi, the manpowef requirements of a single state woirld not seem^ to serve theT)est fnterests ' 
and;needs ^ the student population. 

< . Appropriate repr^seitation of tf^e enriploymeaf settings for an occupation re^nd ins somSwhat 
<^ a debatable issue^ particularly when the survey purpose is to identify curriculum content; Should 

^ Ithe survey equally represent all types of employment sel;tings^ that trainees may be prepared for a 

' Wiety of employment opportunities as conditions and the job change over time?-4rrshould the • 
locus be upon predicted manpower requirements? Opting for manpower foretaste has th^ appear- 
kice of sound planning apd practicality;. On the other Hand, broadening employment options for 
the individuals to be trained seems ijiore attuned to th^areer needs of jtudents, with training pro- 

^ grams encouraging the development of skills that can moVl readily transfer to new performance con- 
texts. Cpnsidering the limitation? of cuh^ent manpower for&asting r^tthods, their inability to deal 
with the myriad of small jobs and specialty area& having reTatively minor manpovJer requirements 
by tbemsefvos, apd the constantly evolvirtg technology and demand for many occupations, it would 
seem inOre appropriate to base repr^ntation.Tirst upon the broadgr range of possible employment 
situation?. This woulV^nd to fumish training appropriate for students in areas of low population 

i density as we)l as for. those /n major metVopolitarrareas. A balance of concerns couJd then be ob- 
tained by augmcfnt^ng the focus in those particular performance contexts that have obvio^y high 
potential for near-term employment opportunities. By this mean$ it may perhaps be pq^ble to ac- 
quire the "best of bot^ wprlds." ' j ' . , , 



. Employment sit?^ afHirveyed workers, thus^ sbdwyg fromlarge metropolitarTWeas, Jto 
j ippderate-sized or remotely situafed cities, to smaH sc^itt communities. Some emphasist^how- 
a/er, wpuld b^ upon the larger population centers. ^ w 

^ Business enterprises to be ci)nt?teted at ^ch^lected location may be essentially targets of op- 
. ^portunity, within the tqnjtraMrt ts die survey plan. These ar^ ones that are available and accessible 
^ 40 survey administrators in each ((x:ale< * . ^ \ 

This 'diversity of locations and industrieS^ distrrblRe^ across majori-egiorts of the country (or 
• other geographk: units of titie scope of interest), should approxin^ate a reasonable representation of 
the overall work situation in whicjll workers in the occupation o3|(ain emplpyment- The range of 
variations jncluded in the survey should certainly <end assurance of the^eaningf ulness of the data 
^ where^onsensu^ is achieved, while*acknov*{jedgfng the diversity of position assignments encompassed 
'wtthiil an occupation. Information about this concensus and dji^ersity coukl be helpful as one basis 
fdr making students aware of job opportunities, employment ^peniqos, and areas for skill application. 

♦ - * • = * 

STEP 12: PRI^EST QUESTIONNAIRE 
INSTRUCTIONS AND FORIVIAT. 

Th6 first time a new or someyvhat different population is to be administered a surv^ question- 
naire form it shOuM be ^ed out ori a^sn^all sample of persons of the kind to be surveyed. This 
lerves two pUi^oses. First, it assures that such a group can read an^ uriderstand the questionnaire,- 
and that the personal background items are pertinent to that group. The second purpose is to gain 
experience in locating the kinds bf'>^^^x>ndents needed for the survey. If certain kinds are found to 



be very difficult to identify or gain access to, this will have definite innplications for the arrange- 
ments necessary in.Step 13. It may even be fduftO necessary to reconsider the survey plan devised 
in Step 11. In any event, it is better to discover such problems before attempting to gather the full 
sqt of task data. . ' 

' tTlis pretesting can be dbne with a handful of persons who represeiit the rafige o( tjiose for 
whom the survey is intended, especiaHy if)^ terms of experience and reading ability. It is not neces* 
sary to employ «rict sampling procefiureito Identify suitable persons. Often it may be practical 
to obtain this firsthand feedback simWtaneoysly with tfte pilot testing in Step^ of VolumeX' The 
respdnseis obtain^ may also be used to exercise the data processing programs for Steps 17 arid 19, 

to assure proper programmiftg and layout of output. ' ^ ^ 

« > 

Individuafs should be asked to comment oh' their understanding of the questions and the pro- 
cfedures to be followed.. If they feel that certain changes in the worxJirig-of questions v^ould improve 
their communicability> they should be encouraged to offer their suggestions. Additionally, if at all 
feasible, they sKould be paid fp^ their service, consistent with their hourly fate Of pay. \ 

If this pretesting dictates that the total administration time for a^BS^^p rw^ must be 
shortened, it is possible to randomly divide the tasks within each ^\x\^^i^^^^x\x\ more than qne 
surv^booklet (except for questionnaire Types H, I, and J). Sufficient numbers in each comparable 
group of respondents will be necessary to permit the group data to be pooled as if it all came from 
the same. person. . _ - . ^ ' - 



VICTIVITYE: ADMINISTERING. 
aUESTIONNAIRES TlmORKERS 
AND SUPERVISORS 



DESIGN THE SURVEY, 



Plan Data 

^An^yses 

•_Needs 

•"^Task* fnformatjon 

• InfdrmaK. 

Backgrounds 

• Data Summaries 

Steps 7. 8. 9. 10 



Desigg Question- 
naif es and Their 
AdmintstratKin 

• Format and 

SampUng . 

• Pretest 

Steps 11 and 12 



OBTAIN F^LEVANCY DATA 



Administer 
Qutftionnaires 

• Arranyaments 

• Instnictbrr 

• Printing • \ 

• Raoofnition 

Steps 13, 14^15, llB 







Process T»Q Data 


Report the Data 


H^^reparation 

• Ousters <if 
/ needed) 
^ ^ Summaries 

• Analyses 


• To Participants 

• Formal R^ora 

• Future File 

f 

StepZl * 


Steps 17. 18, 19.20 



► 
► 



^ (Given thatJsbththe design of the occupational su^ey and the intended data analyses have been 
jianned ic Activity D, it then becomes appropriate to arrange.for and accomfplish the actual adminis- 
fatjon of the survey. Survey administration eff^s un(Jer this Adtivity E involve primarily the mak- 
hg of appropriate" arrangements and obtaining printed questionnaires for ea?h intended respondent, 
[here are four pr<?ceClUral steps to be followed in accomplishing tfiis administration : 

Step 13: Arrange to Have Question haires Administered 

Step 14: ' Instruct Local Administrators 

^ Step 15: Prepare Questioonaire booklets . ^ 

► Step 1^: Acknowledge Cooperation of Agencies and Per^nnel .-.._>^ 

€ach of th«e stjefis is described in the sectrdns which follow. In accomiilisbing Activity E anention 
should be given to maximizirig iSne motivation of sunrtty administrators, of local employers artd of 
workers and supervisors responding to the survey queitionnaires. Respondent rnotivatidn '^panic- 
utaily important in obtaining meaningful and accurate information on eac^tesk. Unleacortpletion 
of the survey-is made to seem desirable, partici<)ating individuals may not do their best in later 



portions of task listings gr in f inaj stages of making Ideal contacts with iemploTbrs ahd employees. . 
However, as Guion (1976) notes, ^'specific attempts to increase matlvrftton probably have an impact 
\<m|y up to some point; beyond that they are self-tJefeating^ (p. 803). Jhe rpcommendatipn to max- 
imize motivation bftefi m&y be, therefore, difficult to carry «ut effectively ^ 

' • ^ • . * . . ^- 

STEP 13: ARRANGE TO >li9(VE QUESTIONNAIRES 
ADMINISTI^RED . s - . 

i ^' • ; . * \ ' ' * ' 

Obtaining survey responsef efficiently from many individuals can be difficult to accomplish. 

. Thus, along with Step 14, this step is most critical in obtaining useful questionnaire returns. These 
Steps also are the most sensitive in terms of assuring protection of the interests and welfare of em,- 
i)loyees,.and of making certain that employers or other coo|3erating organizations do not become 
alienated by the survey effort, r ' 



Methbdologically there are two key questions in the process of making arrangements to have 
Task Inventory Questionnaires administered to workers arid immediate supervisors. The first is: 
How, do you locate the right kinds of employees and secure Vieir participation? Thfs is^ollowed 
by the problem of: What can be done to encourage full return of completed qljfetionnaires? 
^ - ' 

Trte guidelines suggested here-assuflne a situation.where a broad national or regional survey for 
a single occupation is planned, with a diversity of loca#ns and industries. Appropriate modifica- 
tions should be obvious when onjy a single major employer or one*metropofitan area are to be the 
intended scope of interest. Additionally, if workers dniy are to be suryeyed (as in questionnaire 
Types C; F, H, I, and J), ft is possible to^mail questionnaires 'directly tcx those workers. This can be 
done with the sponsorship or cooperation of a professional or labor association \q which thpy belewg^ 
whh rfiaifing? made from the association's memb^rshfplist. Accompanying such^^Milings should be 
a lettef 'from the association indicating the association's bacWng and endorsement of the survey, and • 
^ouraging membership response to it! Alerting their membership through. association newsletter^ 
and periodicals is tnost useful. Similarly, if all respondents are to be from.a single large operating 
^ncy, a message from the top of that agency to all lower units assures respondents that prompt 
com^letion of the qu^stiohnaire-is of interest to an(^ sanctioned by the management.^ 

Local adrainistrators. Key individuate in each locaTe ar^ needed who are knowledgeable of spe 
cific employment locations and are available to make direct contact With those employees. Though 
they may commission others to aid in the prpcessi these key individuals serve as the focal point for 
local cont^ts, distribution^gf^yestionnaires, and siort term follow-up to complete the effort. 

' Various agencies conducting an o<>cupatiooal performance survey may have their own source^ 
Of key local administrators, such as a firm's network o^ operating divisions throughout the country,^ 
or local, chapters Of an association or a union.- 

For surveys conducted 6y or for public education agencies it Jms been fx^nd very effective to 
contra^ with tf>e directors of state units concerned with occupati^il or vocational education. 
These include especially '#ie state Instructional Materials Laboratories (or Curriculum Coordinating 
Units) or state Re^rch Coordinating Units, in thdse* states having such units. Other key individuals 
within state departments of vocational or occupational Education also can be very supportive of the 
.s\in«y administration. Together fhey can serve^asa very effective network forgathering Occupational 
perfd^mance data, which can also be ot'mutual benefit to their reSp^^jive constituencies. 
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' STEP 
ARRANGEMEN* 



These mdiyiduals may themselves make direct contact with employers and/or employ others 
familiar with local communities.. .Effective in this r^le ^re professors of vocational education (par- 
ticularly of business education) in the state's higher education system and secondary/poltsecondary 
vocational teachers ih local school systems., By this means responsible community personnel who 
are knowledgeable of local employment settings and ^Cqu^inted with a number of employers pro- 
vide the personal contact that is so essential'for obtai^irtg good survey responses and questionnaire 
returns. A side bePH?fit has been obtained by increasing their acquaintance with local employment i 
opportunities havjng relevance to the subjects they teach. 

♦ 

Jhe key administrators in each area are best contacted directly, in person or by phone, to 
secure their cooperation and participation. A contract for their/servioes or for the purchase of a 
certain number of completed questionnaires is then issued tb their agency or to th*^ as individuals] 
.depending on the circumstances in each situation. This contract agrees to pay a set amount for 
each completed questionnaire; ^ch-as $10 or $20 for a short questionnaire, to $40 or $50 for a 
lengthy complex questionnaire involving difficult arrangements ir> securing the required respondents. 
These monies may be used.a^ necessary to compensate employers and/or employees for time used 
to answer ^each questionnaire. * 

Ldcal administration process. <ocal employers should be C9ntacted and informed of tfie nature- 
"^hd needs of the survey. Their approval for contacting specific workers and/or §uperuisors should be 
obtained. Often in smalld^gani^ations they will themselves serve as the point of .contact with par- 
ticutafc employees, or int<l^duce the tocal administrator to them. In other instances they may desig- 
nate mother person in the organization to serve that role. 

^ep^nding on the nature and scooe of the survey, sometimes it may also be useful to s^cbre 
the endorserhent of relevant associatiOTis of employers to encourage participation by these business 
firms. This kind of endorsement, however, takes some tirihe to acquire. Associations may need to • 
clecH- their action with their governing board at its next meeting. It may a(t times also be appro- 
priate t,o inform and secure the backinjg of a local employees union, though typically too few work 

ers are used'from any one firm to mak§ thi3 a significant and necessary part of the process, 
• - — 

Telephone employers in advance for an appointment. J^is important that the normal lines of 
communication^Kmkhin an organization be followed. Initial contact should always be sought-with 
tlife top management of the local operation; that is, vyith the owner of ;a small business, the general 
manager, persorjnel/nanager, or other persoh having general responsibility over the employees. The 
objectives of the survey ar>d its outcomes ^that may benefit the business or the employees should be 
Explained. The-l)Ccupation or area being surveyed must be carefufTy described so as to identify<the 
kinds of employees to be included. If intermediate supervisors are to b^' involved irkdistributing 
the inventories, tis helpful if they are also personally contacted. • 

The local*s^frvey administ^^, along with the employer or manaper, should identify the spe- 
cific kinds andiTunriber of employees who are to receive the questioniiaire at each location. Volyn- 
tary^ooperatipn^should be solicited without using coercive pressure. A positive and appreciative 
• attitude toward *the survey is most desirable. ' ' • 

Each question na'ir^isf^ complete package for self-administration. Some managers may prefer 
to distribute the questionnaires, and then have the employees mail them directly to the local admin- 
istrator when completed. If this is*done, each employee'should be d^ked to notify the manager (or 
hrS representative) when the booklet has been mailed, permitting the manager to monitor which 
questionnaires have been completed. Other managers may prefer to have completed questionnaires 
. returnedie-thfiir office for iorwarding tb the loc^l administrator. High^tand faster connpletion 



rates are obtained when managed are interested enough in the survey to collect the questionnaires 
from their employees. ^ * 



STEP 14: INSTFyJCT LOCAL ADMlKllSTRATORS , 

If at all possible, all the key local a'drpinistrattorsrshoutd be gathered together at one central lo- 
cation for a day to discuss their role. This serves to give each a-jcommon understanding of what's 
intended, and an opportunity to raise questions abp^he process; It is most helpful if they all fully 
njtKlerstand what is being done^ and the reasons for rfln/Vith such a senie of purpose and value their** 
[Participation should be enhanced. This meeting shfi||Ud be Field at or just before the time the survey 



questionnaires are ready for distribution. ^ ;1\ / 



Each administrator should be given written ins%ction5. describing what issues to attend tp, 
with particular attention to protecting the privacy <ff>g?pondents and securing voluntary participa- 
tion. The instructions should also indicate possible ways of' thanking and acknowledging the con- 
tribution of each participant (per Step 16)r An example' of one such possible set of administrator 
instructions is illustrated in Figure 18. These would acbpiJ^^V the occupational definitions such 
asfliven in the Figgre 17 example. 



- Of special Importance is the need* for locaf adtnjpistra^ to report information regarding the 
nature of each employment setting used. This data can add :o thelftackground information pertain- 
ing to each questionnaire. A sjmpfe worksheet, as in Figure 19, should beTnade available to record 
and transmit this information. It should key each item to a Specific respondent by means of a pre- 
determined code for each questionnaire booklet (see 9^ep 1 Si^^s^"^ . ' 



INSTR4JCTI0ft 



/A^itional' Information an(f Guidance to Help ^n the' 
Local Admifiistfation of Task Inventory Questionnaires 

1. Identifying Employees to Answer the Questionnaire* . ^ . / ^ - ^' 

t Persons seleqjjed to answer the Task inventory Questionnaires should be as noted on the attached sheet 
desi^fbing workers and supervisors % 

of Employer Agencies Needed 

^- • 

The fwlowing chart indicates'lhe number of each type of empioymg agency to obtain for the particuiar 
types of employees . * 



4. Governnnent ^rvice or Education ^mall operation 
^ iess than 15 employees in the job area) * 
^ *^ 

b. * Government Ser>(ice or Education [large operation 
20 or more employees in the job ar^a) 

c Private 6 us inns or {ndustry<^(5n7a// ope rat tort: less 
Jhan 1 5 ehrtpioyees in the job area) 

d. Private 6y»ness or Industry (/arye operation. 20 or 
* mwre employees in the job area) 



V^rkers 
2 



^Immediate 
Supervisors 

2 

3^ 

4 

3 



r 



2. Inform of Purpose"^ % ' 

Each questionnaire respondent, as well as each higher agency official contacted, sh6uld be informed of 
the purpose of the Task Inventory Questionnaire, The following comments are provided for your pos- 
~ sible use in telling employers of the.purpose of this data-collection effort: 



The purpose of this questionnaire is to identify what job tasks are relevant to tbe occupa* 
tion being surveyed. This information will be used in a cur/iculum project to identify the 
extent to which each task is relevant to that occupation, servir^gas one basis for assuring 
that training's cH^ected at the more relevant tasks. 

Ai^omposite of several questionnaires for that occupation will be used as the basis for 
analyzing what task skills are now performed and expected of yvc^rkers. This composite 
will represent a cross*section of geographic and industry views. 

# 

The problem ts not a simple one on which to obtain concensus. Each job position has its 
own set of requirements and assignments. The questionnaires will be analyzed to identify 
significant p^s of the occupation, 



• . • ♦ * 

Additional copi^ of questionnaires are included for leaving with management officials, as you deem 
appropriate. — 

,* 

.4. Time-Saving Fmtures 

' There are several time-saving features built into this questionnaire. It maV be useful to tell participating 
employen of these, to assure them th^t we were aware of the value of their time. 



Figure 18. Example oHmtructions t<4|pcal administrators. 
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a. 



Questions on background information are, kept to a minimum absolutely necessary to this survey.^ 



^ b. By use of prepared listings of tasks for an occupation, the employee is only asked to recogQize 
each task, and not have to try and recall each work activity. Reco^ition is far faster and more 
complete than is recall. ^ ^ 4 

c. Answers to each task statement need to be given simply by circling a number or by checking an 
* ^ Item. ... 

5. Assurance of Con fidentiality „ . ' 

There should be no penalty possible for giving an honest answer or for refusing to answer a particular 
item {or even the whole tjuestionnaire, if that shouldjyxur). In no way should the respondent's higher 
management levels be informed that a person "failed to cooperate." Even the nature of the individual 
answers should J3(C kept confidential; in no^way should they serve to embarrass or harass^e respondents. 

1^ To help accort^ish this, the completed qu^tionnaire should be placed in the Urge manilla envelope pro- 
vided, and sealed b^^he respondent. The sea!ed^»wekJ^e>h^uld then be returned in accordance with 
local plans. It is ddulStful that the questionnairje seeks any sMsitive information, but the caution seems 
usfl^l to assure that we doJJot madvertentjj^Daeate a problem. ^ ^ ^ 

6. Assurance of Voluntary Participation^ 

Each employee always has the right to refusejto answer ajparticular item on the questionnaire. Please 
be sure to inform eacii one of this option, but do so in a way that does not encourage them to omit * ^ 
NOnswers very often. Discretely tell thern of their right, but stress the survey nee^for their experienced 
judgments. 

7. Spot Checks to Assure Compliance with Adrntntstration Requirements 

If you use persons from other' agencies to administer the questfonnaires, it fhight be useful to perform a 
spot check occasiohally with cooperating firms and/or employees. This could provide assurance that the 
questionnaires were in fact administered to appropriate efnployees. By asking such cfijestions as "how 
long did it take fj)r an employee to complete the questionnaire?" it may be possibfe to assess the like- 
lihood that the questionnaires are being administereji properly. 

8. Procedures for ErTrployees to Return Completed Quest ionria ires 




i 



/ 



On the first ilhd last pages of each booklet, each person is told to put all completed materials in the large 
manilla envelope, and to seal it. Then to turn it in according to local instructions. These local instruc- 
tions are the responsibility of each administering agency. You should worlc out these instructions as 
they fit Vour situation. Perhaps a responsible official within each firm could be ap'pointedSe^receive the 
sealed envelopes, and to follow-up on any that are not turned 'in Or, they may be collected on tbe spot 
by you or your representative. Or, they may be mailed directly to ypur office. In this latter case it 
would be^ppropriate to put your address on the envelopes and to prestamp them. The basic intent is 
that no one ir\the firm should have access tp specific responses by which the respondent could subse- 
* quently be harassed'or embarrassed. , 

9. Review of Compieted Questionnaires^ , ^ - / 

A$ sealed envelopes are recieved from employees, there is a need for you to open each and check that 
the questidnj have in fact been answered. The following guideline* are suggested for doing this review 
and foAespondir>g to discrepancies: ' . * ' 

a. ^ Scan each answer section, includir^ the Background Information page, to determine whether 
answers were genially given appropriately to all tasks listed. 



i 



Figure 18 — Continued 
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INSTRUCTION 



If it appears that the employee chose not to provide a reasonably complete set of answers, eNher 
contact that person again ahd try to get coQ^inued effort on it, or find a person in ^comparable 
'type of firm to complete another questionnaire. Additional questionnaires are included for this 
purpose. Please note an^| such changes on your AgenSy Worksheet. 

If the answers are complete but nonsensical garbage/accept them without comment. Note your 
evalu^tfon on the outside of the envelope and on your Agency Worksheet. (Do not convey this 
information to the employer.) Then, contact a pereon in some comparable type of agency to ob- 
tain a complete and meaningful set of responses. 



c. 



10. Extra Questionnaires 



11. 



Some additional copies of the TIQ are included with the materials sent to you." These do not have pre- 
stampeiJ identification numbers. These can be used or distributed at your discre'tion. Please return any^ 
unwanted ones to us. If more are needed, please phone us collect. • ^ 

If additional copies are used to ob^Sfin employee responses, please be sure to put an appropriate identi- 
fication number on the cover of each setjused, and record this number on the Agency Worksheet. 

.Comptetion of the Agency ^rkshee^ ^ 

In the package of materials sent to you i^orm labeled Agency Worksheet. The last column is for your 
local use as you see fit. The first column pii^vides the identification number for each questionnaire re- 
spondent. The balance of the worksheet should be used to provide us with the following information on 
each respondent: 



b. 



Size of tfie Operation. This column is to be used to record the size of business operation in which 
each responding employee works. Indicate whether that business operation is large, moderate, or 
small in size. This size indication is judgmental on your part, but you might consider it large if 
there are jnore than 20 employees working in the immediate area, and as small if there are Ies4 than 
5 such workers. Thus, it is the size of the occupational function in one location that is noted; not 
the si2e of the employing agertcy nor of the parent company. 

Metropolitan Area and State. The general location of the employment setting should be recorded 
for each respondent. Exmt city is not important, as long as the metropolitan area is named. This 
IS more for regional identification than for pinpointing work sit^. However, ii the location is a 
rural or isolated one, this should be noted. 



c. Cautions. Tell us of any particular incidents br conditions t hat occur n 
lems interpreting the questionnaire responses VTh is information possiSI 
properly analyzing the questionnaire results. ' 

1 2. Feedbacic on fhvbl^ms Encountered 



nred-Jhat might create prob- 
1617 could be inr 



important in ' 



It is most urgently re<|Uested that you hote any Ignificant problems encountered in administering the 
questionnaires, apd Inform us by a memorandum after your work is done. This feedback will help us 
to assess tf)e ne«l for procedural chc^nges to yield effective and efficient data-gathering processes in the 
ffture. ^ 



1 3. Showing Appreciation to Participants 



qOKtioooai 



a. Eacfr local administrator of these qoKtiODoaires may want to indicate specific means of showing 
appreciation to employers cooperating vvith tliis study. Some excelfent procedures that have 
been used in the past have been ta s^nd eadh person a commendatory letter or a printed cerlifi- 
cat« of appreciation for participating in the $|titfy. In one instance these certificates were signed 
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with .the name of the state governor. Or, you may have equally good means for using this 
opportunity to cement relations with employer representatives in your area. ^ 

' b. If you promise an employer a copy of the results, be sure to get the full correct address to 
which they should be mailed; "We can^end them direct to that address when we'prepare the 
report of summary descriptive data. This report would not breakdown the data by empfoyer/ 
city /state/region, but would be a composite from aM data locations. • , 

14. To Return the Compieted Questionnaires 

You may ma^ corripleted questionnaires back to us as groups of them are completed. These should 
be addressed ^ follows: 

i 

« Name * 
Title / j ' \ * 

Address . ' .. * 

15. ToGet^id 

When completed, hopefully within two or three weeks, send your regular agency billing form (or 
. invoice) to: • 



Name 

Tjtle 

Address 



I of god^; that is, i 



Indicate it is for the purchase of godfls; that is, for so many completed Task Inventory QutJtftnnaires. 
I Also note our Purchase Order number. Payment to you will be initiated promptly, but cannot begone 
until your invoice is received. . - * 

16. Call for information or Assistance ^ 



jhoeed a< 



-♦f you have any questions, ohieed additional help, please phon^ us collect to discuss the matter: 

Phone 
Nann«(s) 



17. WE THANK YOU FOR YOUR PARTICIPATION IN THIS SURVEY^ . 

♦ * s 
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^ AGENCY WORKSHEET 

(Please return with comfffeted questionnaires) 



SURVEY 004 



12 ' 



Agency 



Questionnaire 
Identification 



No. 



Job Type 



Size of Operation 



Metropolitan 
Area dr City 



State 



Cautions and 
Comments 



Noys 



12-081 



1-2^2 



1-2-083 



1-2-084^ 



2 1-082 
^ ^-1-083 
2 1-084 



^ogr9mmer 



A 



Supervisor 



■t 




iGf PREPARE tDLUf^STIpNjSlAI^ BOOKLEtS 

When all pla 



. ling dnd*pilot testing^s been completed, al't revisions rnade^ instryctfons drafted, 
aM ^.nsgi^r sec^nsiand bdckgraimd she^ets designed, the f ask IrWntory Qtipstionnaires are r^y * 
,for [vinting and binding, f € sure that print %}ze us^ on .^e qu^ibnnaires is easily readabt^: suit- 
able t6(^ possible older respondents and^or^iise in shop frreas which mdy have inadfjquate Ifght for 
reding smalf print? In estimating the rfanfAer of all materials'to be printed, ^llow fi>M5 tnjf^9^ 
more ofr^ach Ifbrm takeover anticipated tosses ptcjuest'ionnaires due to faulty response. Awprovid 
for additional "sample" copr^s fpr the retention coopjerating em^iHoy^rs^and associartions, as well 
asthe key lo^l administrators* •'^i ' 

* • A$sen#Hng each qu^si^onnaire. QuestioAnaire booklets should! be assembledlrP 
. seqtxerlce: 



le following 



4» 



1. ^ Cover page (s§e Figure ^^^^ . 
2. , Introduction page (see Pfgyre, ^1 ' \ 

3. ,B^k^ound pagg (see Figtires'4 and b)^ ^ 

4. instruction page (segXjSures 9,J0, 1^13/^nd 15) 

. , ' * ' ' ' .-"^^ : ' \\ 

5. * tist of tasks and accompanying answer sections (See Fi5uresT% J4, and 16) 
-6. ' Comments 5«:lion^see F jguj&ess 7 ^and 8) / , * * 



' ^When the questronnarre bookfc^re to be fnaileid directly to responde'nts^Si^ch/^iil a survey of the 
■ rwembership of a professional or 1abor.a$sociation,lt is important to haVe;af\ int|^6ductory letter ac- 
compaRy the TIQ booklet. F'refferabiy'tl;lis should be from the endorsing association, describing the 
^ insportance and urging members to complete and return the questionnaires. 
; • , ; . . . ' ■ ^ • , , 

Instrdctrdhs for retj^rning the completed questionnaires shpuldbe noted conspicuously. If the, 
^ cpmplet^ qoestionnaire booklets are to be rnailed^ackby each respondent, bp sure to incli^de -a 
preaddresslpi^ stampe|j|§turrwnVi^^ - ^ * \ * ' f 



r Depen<Jing on the questionnaite type selected, *the "occupational survey bo<^lets for.each^re- 



^'fl>Qndeht group )]pld contairfihe following task questions 

. . ^ ^ . Taik Question 




Type ot Response 
to Question 



4 



BdbkletW Workett^ 
Bjl>fJklet *or Supervisors^ 



TypeB 



Booklet for Worker Gr^b 1 
Booklet for Worker Group 2 
Booklet f or^jipefvjsqrs 



Signifigarlce (CX3) 
Occurrence (02) 



Occurrence (Q1) 
Significance (Q3) 
Occurrence (02) 



Circle Number 
Checkrnark 



Checkmark 
Circle Number 
Checkmark- 



5A 



ERIC 





f V STEP IS 
i' BOOKCr 
PREPARATtjOM 



LIST 
ACTIVITIES 



0 %|k 



"BUSINESS DATA PROGRAMMERS 



■ 4^ 

^ '(Form 6) * 



■ornaB 
f976 




' This Lr$f of Activities is inteiided'fo?lfcsearch .purposes. It js 
•not ddctrinal or directi^in nature, but*-it ts intended to in- 
plud^ all a^ivlties of any significance which might be per- ^ 
formed ^yinost Business- D3ta Programmers as part of their ^ 




; ■ 



The Tttk lnventory.Qu«stionna^as, of 
vtfhtch mis List 'of Activi ties Wpart. it 
being •dminittere^^fttv^^wwcltprofect 

Tht Center for*V^tionM^ducetion 
The Ohio State Univertity %^ ' 
Columbut.OH 43210 

In colleboretion with eight state curric- 
uium laboratories epd vocational reieeVch 
agencies throughout the nation. 



Figure 20. Exapn^le^f a cover for Tld booklet. , 
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TASK INVENTORY aUESTIONNAI^E 

» 

^ ^ Introductic 



' You arerequest^ to participate iW provipfing iliformatipn about the job of Busine^ Oai^a 
.Prbgrammers. In combination ^ith the^espo^ses of many other ex ^ 
supervisors, your answei^ to questions on the Task Inventory Questionnaire will help deter- 
^^thavery specifically what job activities hoW^ are part of the work of Business Data Program-* 

m 'As ah individual experienced with the day*to-day functions^apcKwdr(<: requirements^pf 
Business Data programmers, either as a worker or* as a supervisor, your assistar)de is^mostW 
sentiaL You are asked to provide some of the detailed information that is necessary .to sys- 
/ tematicafly! identify the- performance cohten^'STfRe occupalioh as it occurs i^iff^rent ' 
employment settings. This will' make it possible to plan more useful 'and rea^K training 
^rograimsandoccupatioriardescriptions. flS . 

i Should therei^be any pamcular items you prefer not to answer, you ^e cer;jainly free to 
omit tKose items: 1 However, yoUr c|^nsideration of each of theseltems is most important to 
tl^e effective accomplishment-'Of this occupational study. We need your judgments and 
kBpwIedg^f^thre wqrk situation ^it actually, exists^ Please base:,ybur answers on your own , 
expeiiencR^ith ihe work-done by a Bdsine^C^ Prd^ramhier. Composites of a larger num- 
ber of responses from all over the country vyp i>e aspd;"the ^swers of any one person wilj * 
never be reported. Thus, your paiiicipatioh wiji terve to provide a representative sample qf 
the work as it occurs nationwide.'^ , ^ 

Mo$t of €ie a^th/ities (or^tasks) performed by Businesa^ata Programmers are listed in*^ 
this boof^et. While not all Business Data Programmers wilt do all the^ activities, this listing^ 
'should mclude nearly alf of ijie job activities performed by any one person. I^ou note that 
some activitfes are missjng4tom the listing, please writeihem in this^ooklet (^on a separate 
piaper. Turn in\these additions along with your complet^questionffiire booklet. 

'>nv6 'questions accoi'Inpany this booklet. You^are asked tb answerboth questiohs. 
Please work on one question at a time, finishing it befoi'e string on the^ext question. 
{This paragraph applicable only to Type?H, I, and J>) " . ' 

When finis^ with the task questions, pleaseV'lace this List of Activities booklet in the 
accompanying maniMa envelope. B'e'sure you have also answered the Background Informa* 
tion Sheet an^ the section for your comments and suggestions. Seal the envelope, and turti 
it in according to direction^given you locally/ ^ 

THAl^KYbu FOR YOgR COOPERATION. . ' 



IS 



Figur^l* Exampb of mtroducttoo pagifor 
quettiQnnairi Ywpondentl, 



^ ♦ STEP IS; 

BOOKLET 

prepAAations 



TypeC 

Booklet for VVorkpr Group 1 
Booklet for Worker Group 2 

TypeD 

r 

Booklet for Workers ^ 
Booklet tor Supervisor ^roup 1 
Bookiet for Supervisor Group 2 

Typ^E ' * 



Booklet for Workers 
Booklet for Supervisors 

Type F 

Boj>klet for Workers 



Type G 



Booklet for Workers' 
Booklet foi^ Supervisees 



^'TypeH 



Booklet for Worker Group 1 
Booklet for Worker Group 2 

Typef 

Booklet for Workers 
Booklet for Supervisors - » 

TypeJ • , 

Booklet for Workers ^. 



Tas/c Question 



Occurrence (QD 
' ^Sigoificancf (Xl2) 



' ' * Occurrence (Q1) 
Occurrence[iQ2) 
^ignifican^iiii^)^ 



* HDccujT^nce (Ul) 
. . Significance (04) 



Significance (03)' 



ifjcance (03) 
0*^^CB (02) 




ence (Q^Yand 
lim^ Spent (Q5). 
ficanpe (03) 



Occurrence (01) 
Time Spent (05) 
Significance (04) 



^^.ccurrence (01 ) and 
Time§pent (05) 



Type of Response 
to Question 



Checkmark 
Cipde Number 



Checkmark 
' Checkmark 
Cjrcle Number 

s CTeckmjrk. 
Circle Number 



Cir^cle Ni^mber 



Circle^Numb^-^^ 
Checkmark . 



Checkmark and 
Write Nurtit^r 
Circle Number 




Checkmark and 



Write Number 
Circle Number 



Checkmark and 
Write Numt>er 



Later storing and referencing of questionnaires can be facilitated by using a different colored 
stock for tbe cover of-booklets tor eafh.different occupation, when more than one.occupation is 
l^e surveyed. • ' 
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CodiiHieac^ quettiormai^l To relate each conrpleted questionnaice to the type cff respondent 
and employmeht situation inten^^S, it is useful to stamp of write a unique coc^^ identifica^ipivfium 
IJ^r <yh the outsMe of each TIQ bc>oklet. These numbers also should be refcprdwl on the Ajp^ , 
Worki^eet^ forfurther assurance tljatkich background information can b^^^ja^ mtmhy 
proper respondents. This nurpbering is-ndt intended to-personallyJdentify We^c^^^ re^ppndertts,^ 
' but -serve orUy^.to facilitate data processjpf^nd accounting for questionnaires ai^^ied^ e^ch^djrum^' 
trator. ^ r i / ^ ^' • . , .^.^'^J^v ^ 

- The su^ested cWing system is one'that will be compatible witb tft^data cafd keypunching 
' .iystem'to be used in Step 17. It consists of a likely maximum 6i 10 digits <Table i): five digits 

map/^ff^e fpr small one-time surveys: .one card cdlurtin each lor kind of responderflt; response ^ 

- grotij^^iir^^minist plus two columns for individuals when less than 100 are used per groi^. 



✓ 

Table 2 



Id-D^jfit Identifying Co<Je for TltTIJooklets 



Card Column(s) Row definition for Cojymnis) , 

■ . . ^ — -^-s- — ^- • — : — : 

1 , 2, 8r 3 * Occupatioo^redy or Function BeingSut^eyed . 

(allpwirrg^p to 999 surveys)-. ^ ' * ^ 

4 ' Type ofSuryey hHoondent: 1 I • \ # 

. • Row 1 - Worker in the Occ^ipation, Area, or Function 

V Row 2 - Imrnediate Supervisor of Workers in Occupation 



Response Group0iljthm Respontfent Type: 



^ Row 1 -^Srd^) 1 - \ 

Row 2 — Group 2 
> , ^ (etc., allowing for up tqpirlfc groups), 

5, 7, & 8 Individual Respondent (yieldio4 a unique code for each booklet, 

, ^yhen used in conjunctiorr with first 5 digits; allowing up to 

respondents per occupation and respondent type/youp) 

.9 iSe 1 0 " Key Individual or Agency Administering the Questionnaire 

^ ^ (allowing up to 99 .administrators per survey) . ' ^ , 



^ This identifyipg number can be displayed for ease of reading by use hyphens ^eparafkin^' the 
major columnar definitions, s^^k^as: 

. ' 004-1 208tl2 

This would denote the fourth occupation^urveyed, administered to person 81 in worker group 5 
^- *by indivkJual or agency 12. / ^ , 



STEP lis 
ACKNOWLEDGEMENTS 



A npcord sHouW be kept of the pjaces and persons to whorh copies of the Task Inventory- Ques- • 
tiontfaire.gre ^ent. If mailed dirtied to workers, then their names and addresses jhould he recorded; 
If distributed to local administrators, then there should be a recortl of which types of questionhaire 
and iniehded respondents were included; as i^^ell as the identifying numbers involved. , ' . : 
, . ' ' / ' ' ' ' ^ ' 

Similarly, a redDrd should b6 maintained of the questionnaires received from respondents or 
administrators. Keeping these'recowls together will nwke it easy to detect delays in returns and to 
initiate follow u0 eff oi:tsas fnay be suitable. At any time it^ouW be possible to calculate the per- 
centage of returns bf completed questionnafreis^ \ ' > . !y 

STEP 16: ACKNOVyl^EDGE COOPERATION 6F 
AGENClfed AND PERSONNEL / j 

Soon after the completion of a survey administration it is highly reco'mmended that feach par- 
ticipating agency and individiraHeceive a letter or other notice of appreciation, ^ocal admmistra- 
tors shouW'do this with their en>ployers and employe^si The survey sponsor or plartnef should Ho ^ 
this with their key local administrators, and gi vq recognition and crectit in subsequent reports, Of the -^^ . 
survey data to the essential part played by this cooperating network of administrators.^ 

In addition, a nui^ber of employers definitely expect to receive at least some Igrf-ief sumowry of ^ 
results for theiir participation. Tbe appropriate content of such feedback reports will vary from sur- 
vey to survey, butJdeaJtY should fornii^ttocument the descriptive dita and rei^ults of analyst. ^ 
Since such a report usually consumes 4oite abit of time before it is ready for dirtribu^ion^and may 
be costly, ix us^Jally is best -to prepare a shoi^escrip'tion of kea/JBSults. This serves as quick reading J. , 
^nd permits the participating employers to sense that their efforts were valuable and appreciated, r - 
By such me^ it is intenjded to m^ntain the goodwill of such employers, encouraging then) .to be ^ ^ 
cooperative with any future survey nee(tapr other- contacts. This feedback can afeo alert them to . 
the avallabiNty Of the subsequent repor^- of any previous surveys. ' ^ ' r . . ^ - 



ACTIVITY IpROCESSING 
V SURVEY DATA 



DESIGN THE SURVEY 



0 Plan Data . 
Analym 

• Nellie 

• Task Information 

• Informant 

Baclcgrounds 

• Data Summaries 

Stack? fil^ 10 




^ '[ ^ . 

OBTAIN RELEVANCY DATA 




/ 

Administer > ' 
Questionnaires 

• Arcangemyits ' 
« • Instruction 

Pynting 

# Recognition ^ 

Steps 13. 14.15,^9 


ProcaasTIQDtta 

# Preparailiow 
* • Ouilan (if 

# Afial^fW 
StapH7. 18. 19. 20 


^» f)«port the Data 

m TpTlrticipants 

• Fo^nal Record 

• FuturtFile 

* • 

' ^ 5tep21 

< • 


" ^ 

-Oesign Questton- 
naires and Their 
^ Administration 

• Fonnatand 

Sampling 

• Pretest * 

Steps It and '12 


4 


I 





The prcx^edjjral steps in Activity F involve the pro^^ing ot sui^ey date;bpjbftre(*lpt bf the * . 
completed Task Inventory Questionnaires that were administered by the efforts4n the preening 
Activity E.- Four possible steps are described here, though specific elerrofnts of these step^ are de- _ 
« pendent upon the particular plans devised in the earlier Activity D: 

Step 17: Prepare Questionnaire Response; for Processing 

^ Step 18: Quster Workers Into Job Types . ..n ^ ^ ■ 

Step 19: 'Compute Summary Descriptive Data ' ' * 

Stap 20: Perform Analy>^f ihe Survey Data ^ -L c-i: " v ; 

STEP 17: PREPARE QUESTIOIMNAIRfYieSf^lVi^ES 
FOR PROCESSING ^ . o T 

Audit of each jx>oklet Ai^hen qu^ion^aire booklets are/eceived, th^ ihouki bfrtcannfd for 
ponripteteness and for compliance with-the directions prior to keypunching. Those evklencing major 



^vkMis failures of respondents to follow the ouestj'onnaire directions should be rejected from fur- 
ther use in the surveys Rejectionsmaybebased on such evidence as: j 

1. Higiyv inconsistOTt'and incomplete^respcfttes. v 

2. Supervisor apparently rating his own job as supervisor, not the performance of wQckers 
in the occupation. . * . 

3. Inappropriate respondent^ as wHen^ background sheet notes an alternate job title and this 
{substantiated by the overall pattern ol^ task responses. (Job title ^houkJ not be the-^le 

^ basis for rejection, since nwny incon^stendes exist for titjjw in practice.) ^ - 

Task responses within a questionnaire ihow item discrimination, such as when ^ 
every task is checked on Question 1 or 2, oi^ atl are rated at the same scale level on 
Questiom 2^4, or 5r - _ , ^4 | 

5. Use of a great many multiple responses per t^sk on Questions 3, 4, or 5 (multiple re- 
s^ses are n^t by tl^ computer routine). ' ' • 

6. Identical response patterns f ronwHI workers in one participa,t1ng shop or office. 

7. No*tasks rated after the first few pages of a booklet, indicating the respondent cho^ not 
to completeifce questionnaire. ^ 

Questtonndtre^ rejteted shduW be noted and recorded, alonqwith the reasons for their rejection. 
E»mination of these may provide clues to improvemertts needed ip future surveys. 

Usually the item •responses can be keypunched directly frpfWi the questionnaire bookl^. For ^ 
efftdem and accurate keypunching, keypunch operators should not be require to edit or Interpret 
the data. Consequently, scanning for completeness should also include the clarification of illegible 
responses. Legibly marking correct item responses with a red pencil will help the keypunch opera- 
tor, witfiout destroying the original marking if .later som^lbne wants to \Ae it. 

Data coding for keypunching. Instructions for the coding of responises are provided in Volume 
5, with only a brie^ summary of salient features given here.. Using^he respondent identifying^num- 
ber as the first 10 digits of each card prepared for a questionnaire. Columns 11 and 12 ' 
specifk: question for whk:h responses are to be keypunched, and Column 13 isused to^ 
card riumber for that question. The double digit capacity is used for question nuntbers ! 
dittonal questions may be accommodated. ^7^^!^ 

— The balance of the card columns are used sequentially to record task responses. These should 
start on Card^OI . Respondent background and reactions should be placed on 9 separate card, start- 
ing with the identifier code. This card may also accommodate thfe record of equipment itenW^he 
indivkiual checked as used or operated. , . ' ^ 

Information from the /\gency Worksheet may t)e included with respondent background data. 
To permit the size and type of city in which each respondent is employed to be coded, it will be • 
necenary to use an atlas to d>eck location and population. ^The proper code should then be written 
4n red pencit^irectly on tiie background sheet. Keypunch operators can be Insmicted on which 
card column to locate thisjgdte- Suggested categories of city characteristics ^Qd their coding are: 




ERLC 



62 



1 Major metropolitan area, including satellite suburbs *k ^ 

2 Moderate-sized city near larger popufatic^ center . ^ 

3 ' Moderate-sized city, but somewhat remote f rom^ major population centers 

4 Small town ^ ' , . '^^ 



5 Rural or isolatkl work site 



A' 



OtNr categories can be devised to fit the needs of a ({articular study and its intended scope of in- 
terest. If this \s done^, coding instructions other than those provided in Volume 5 will ne^ to be 
^est^lished for keypunching. * 

^f written comirjents. The background, answers to some tasks, and reaction pages of 
each booklet, as wed ais the Agency Worksheet and any accompanying notes, are sources of written 
.information that cannot r^eadily be placed on data processing cards. These sources include (a) back- 
ground descripjtors that are not part of a standardized list, (b) new task statements, (c) comments 
and suggestions of respondents, and {d) cautions and comments of local iKfrninistrators. Generally, 
the simplest'^pproach to recording and organizing these verbal. statements is to type thern out, using 
a separate sheet f6r each class of informatidn. Associated with each statement should be a short ver 
sion of the identifying number. The individual number (digits 6^ 7, ^nd 8) and the agency number 
(digits 9 and 10) can be omitted.^ Thus, each comment will essentially be related onty to the kind 
of respondent and the particular group of respondents^wtthin that category, if any. If inore than 
one occupation was surveyed, then the comments of workers and supervisors should be grouped by 
the pertinent occupafion. An outline for this clerical recording of verbal statements is presented in* 
Figure 22. " , ^ * ' • 

There is no^need to record a rating given to a new task added to the list. Since few respondents 
ever •add identical tcisks, these ratings are of very uncertain value. It is better to save these tasks for 
potential inclusion in a subsequent resurvey of the occupation. These additions, or any^ggested 
modifications to listed tasks, can be edited and cited in the formal report of the survey (Step 21). 
Where^ task list W3S divided into two separate sections to reduce completion time requirements, ^-^ 
statements added on one section should be comp^ed with the other section to eliminate tasks al- 
ready listed and surveyed. ^ 



STEP 18: CLUSTER WORKERS INTO JOB TYPES 



' In those studies where it is desired to identify different types of jobs existing within Siework 
area surveyed. Step 1 8 is performed prior to any summarizations or other analyses of the task data. ^ 
This clustering is based upon some selected*commonality of taeUc performance. Responses can be 
used from Questions 1, 3, 6r 5. However, Question 3 is rec^mefxied over Question 1 as the basis 
for clustering. No recommendation is made at this time bety^n use of QMestions 3 <^ 5. , 

As previously noted ^ the Step Tl discussion of selecting re^fifhdlents, different statistical 
niques Have varying practical capacities for the number of respondent^ that cah be used in any one* 
^application of the' technique. In sonrie studies, particularly when using factor analysis as the "duster- 
ing" techrrkiue, it may be reasonabfe to divide the respondents randomly into subsets that are wfi^in 
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BACKGROUND INFORMATION ^ 

. : : : 



Worlwt Supervisor* 
iDNo. StBtmrmt . f fD No, Statement 



Other Typet of Orawitatiom or imiu i U m Ghwn; 

' . Work*. S«p«v«on' 

/Dfifo.' Statement tD No. ^ * Statement 



.OtfierikMiroM of Training Given by Worfcen: 
Worfcen 

JD No. Statement 



TASK STATE^IMXL 



AdditiomtcHe the^iuty ^etefory iemr iMlder wMch eedi itt^^ 



Woricen - r Supervisor* 

ID No. Statement ID No. Statement^ 



Modifiatiom or Comments on Listed T«ks (ctle tfie t»k number with each statement)^ 
Worker** Supervisor* 

ID No. Statement *^ ' ^- ID No. • Statement 



REACTION AND SUGGESTIONS 



Worker* Supervisor* ^ 

ID No. Statement ' ID No. Statement 

• . ' [ _: ^ I ^ 



LOCAL ADMINISTRATOR CAUTIONS AND COMMENTS 




X 



Spedfie to Supervisor Questioqjwire*: 



9 — I — ~ — : 

F}S^22, Outline for clerical reoording 
of verbal statements. 
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the size limitations, and cluster each subset separately. Clusters (factory) of the major job types are 
Irkely to appear in each of the respondent subsets. . — 

This section of Volumei3 does not presume to specify one particular procedure for clustering. 
\t^\\\, instead, note several of the methodological rssues and suggest several reference sources that 
should be r^ before proceding with any attempt to apply a cluster analysis. It is recommended 
that a statistical specialist be consulted to fit this step to the needs^f ^ particular survey study. The 
guidelines which follow rely heavily upd^issues, noted in an article by Fred Borgen'and'D^vid Weiss 
(1971). They are intended to outline s6m^^the matters th^t should be understood ar\d resolved 
before applying a cluster analysis proc^ure to the task data of a specific survey of an occupational 
afea. 

There seem to be three major areas of concern : " * 

l/r^Nature|of the questionnaire data for each task. ^ 

' 1 

2. Measures of similarity between the task re^bnses of any two workers^ > 

3. Type of clustering analysis to be applied to.the measures of similarity between each pair 
of workers in the survey. 

.t4aiure of the questionnaire data. Three kinds of data are possible: dichotomous responses 
from Question 1, scaled ratings fr^yji Question 3, and percentage measures from Question 5. (The 
process for converting Question 5 ratings to "percent of time" values is presented later in this Step ^ 
IB discussion.) ^ * 

^ Additionally, the scaled ratings of Question 3 may be transformed from the raw rating to a 
standard score before applying measures of interworker similarity It is argued by some that such 
transformation of raw scores is necessary, to eliminate the effect.of differential means ^d variances 
of individual raters. Any such transformation will influence the cluster resuljts. " \ 



* Measures of similarity. «Any of a wide assortment of measures of response simlfarity are avail- 
able, though some clustering techniques are linlited to a particular kind of measure? Some of the 
possible measures of the similarity (of responses to a scaled task question) between a pajr* of workers 
are: ^ . ^ , 

£d • the sum across all tasks of the scale differences of the raw ratings givenlrp^each 
worker. ^ * 

^ g £d^ • the sum across all tasks of the squared scale differences of the raw ratings given 
by each worker: ' ' , , 

' £XY • the sum acro$ all tasks o^ x^f cross prod|ii|cts of the raw ratings given by each 
^yorkerv * 

^7Ci • product-momerit correlation between the Jwo sets of ratings of a pair of v^orkert, 
measuring tbe extent that variations in one set of ratings match the pther set. 

ft ' • tefrachorjc correlation between two sets of ratings, used when scaled ratings are , 
artiftcfaHy^reduced to two categories, or dichotomous (as may be necessary whan 
the distribution of responses on a scale are highly skewed). Also appropriate for 
. relating responses on Question 1. <. 
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Some measures of similarity preserve the component characteristics of profile data (elevation, 
seatter, and shape) better than others. Borgen and Wefes (1971) indicate that, in examining similar- 
ity measures in terms of how much each preserves these characteristics, Cronbach and Gleser (1953) 

concluded that correlation measures, with the exception of intraclass correlation, 
_ are gerilraily inferior to distance ^difference) measures since they Ipse information j 
about profile elevation and scatter. Similarity measures which retain all profile f - f 

• components indmy^'^t^Qni of the raw cross products and the squared distance^ 
(difference) measures (p. 585). . * . * 

I T 

B6rgen and Weiss caution that * * • ^ ^ 

* » * * 
It is clear that each of the alternative profile similarity measures tends to have ^ 
special attributes. An investigator should consider the unique conditions anrf" 
objectives of his study «nd choose a similarity measure accordingly (|^. 585); 

Question 5 ratings (Relative Tffine Spent) by each worker are to be converted to pe^rcentages 
of total wofk time spfent on each task (Percent of Time Spent) before computing a measure of simi- 
rarity between two workers. This percent^ for each task is calculated by adding all of the Relative 
Time Spent ratings, dividing each task rating by the total of all ratings, and multiplying the quotient 
by 100. This yields the percentage of work time spent on each task by each worker in the survey. / 
Tasks not receiving a rating are considered to be rated as "0". The sum of all task percentage values 
equals 100% for each person, ^n a like manner, the average Percent of Time values for any group of 
woricers indicate the percentage of group Jime spent on each task, with the sum of these also equaling 
100% (Archer, 1966; Christal, 1974). ^ . /^t > ^ > % 

Similarity between two workers on Question 5 can be expressed by: 

• y»ercentage of cpmmon tasks performed. * 

• total overlapping percentage of time spent on tq^ks (the preferred option in most cluster- 
ing studio). / ^ 

Types of ciustaring analysis techniques. Thereiare available both '"tluster analysis" and "factor 
analysis" methods by which job types represented within a^survey may be derived. All methods be- 
gin with a matrix of similarity measures between all possWfe pairs of questionnaire respondents. 

For identifying job types it is usuallv^tequate to ap|f»y techniques yielding "nonhierarchical"* 
solutions; that is, simply identifying the discrete homogeneous subgroups-of workers (those whose 
task performance is more similar within the subgroup thin with vvorkers in any other subgroup). 
The tasks and background of workers withjn a desired subgroup define the nature of that job type, 
if these subgroups are then clustered, it is possible to group themjnto "su^rclusters'^ or higher or- 
der gro*^i>^95 of workers. This is temried a "hierarchical" solution, useful when there is interest in 
the relationships among the clusters or job types (Johnson, 1967). 

Examples of the more tested and readily ayailable methods are: 

□ Tr9n$po$0d Factor Analysis 

This is a speciaUpplication of factor analysis variously k'novyn ^s inverse factor analysts, 
Q technique, or transposed factor analysis. It identifies clusters of raters (workers) rattier 



than clusters of hems rated (tasks) as is conventiorfal jn most factor analysis studies. This 
isdone by starting with measures of similarity between pairs of raters across all tasks^in- 
stead of bet>^en pair^f tasks across all raters. Computer programs for factor analysis 
are widely available a^*ng university computer centers. Any of a variety of similarity 
measures cah be used, though correlations are most typicdh 

□ CODAP's GROUP Program ' • 

f this program package within the CODAP'system of the U.S. Air Force is a clustering pro- 
. cedure that uses^n iterative grouping technique calted "collapsing the. matrix." It involves* 

repeated searching for those individuals or partially formed clusters which have the highest 

remaining similarity. A printout is produced of the tasks performed by individuals Jn each 
L cluster. A companion program package cah be used to determine the characteristics and 

locations of individuals working in each job type or cluster. Similarity measures must be 

in the form of percentages. ' 

□ Ward's^ Hierarchicml Grouping Analysis ^ ' 

Applicable to many different kinds of similarity measures, Joe Ward's (1963) method 
iorms hierarchical cluste^ having minimunn within-group variation and maximum between- 
group variation at each successive stage of'the grouping process. Though capable of hier- 
archical solution, it can*also determine a fixed set of clusters, the appropriate ngmber of 
clusters being <elect^d with the help of aa index of error at each grouping stage. It is also 
called the MAXOF Clustering Model from the concept of AMXimizing an Objective Funo^ 
tion. Ve(dman (1967, Chapter 12) discusses the method and presents a FORTRAN pfb- 

gram and sample output. .Ward also reports a general purpose grouping routing, ider^fied 

/ ' as Group 4 of the PEF^SUB Subroutine System (Ward, Buchhpfn, & Hall, 1967; W^rd, 
.'H^ll,&3uchhorn, -(967).' ' ^ ■ ' 



□ Tryon's Methods for Clust^ Analysis 



i 



% A sequence of increasingly more advanced clustering approaches were developed by 

Robert Tryon (Fruchter, 1954,:Tryon, 1959, 1967; Trypn & Bailey, 1970). The approach 
described in Fruchter involved some judgmental decisions. The 1959 report of the Cumu- 
lativrCommonality CltJster'Analysis sought to develop wholly statistical criteria to replace 
' sbch judgment?. Earlier methods were Constructed for manual analysis; later methods were 
adapted or constructed for computer application. 

' -. - I • • : . • ; : 

Cluster analysis provides discrete, categorical placement of workers into one particular grouping 
of persons doing similar tasks. Factoranalysis, on the other hand, weights the extent to which each 
worker's task performance is related to^ach of,tKe derived groupings. If a Worker 'has a high factor 
loading in only one.grouping, there is no difficulty in Knowing to which groupirtg he belongs. How- 
ever, more typically a worker wiJJiJMwa^ sizable loading in mare thari one grouping. Indicating that 
worker's task perfof mance is siomlar totWo or more.of the groupings. This makes if difficult or im- , 
;)0ssible to assign each survey respondents one particular job type, though "rt is still reasonaWe to 
interpret and describe each grouping or job type* t 

To provide a more thorough understanding of clustering techniques,- the reader is particularly 
ehqouraged to reference Borgen and Weiss (1971), Tryon and Bailey (1970), Veldman (19p7), Weiss^ 
(1976), and Yshorttn.d.). ' . , 
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IntarprMation of ciustore< Ideally, there should be a clear, explicit, and intuitively accurate de-, 
miptiOTi^gf the job type expressed by each cluster or grouping. The clusters should be meaningful 
grdypfngs of workers doing comparable assignn^ents. 

?0 provide sucl^ interpretations, obtain the job tit||, experience/industry location, equipment 
used, and other available background informatioafor workers in each cluster (or loading high on a 
factor). Also, examine thedistirtguishing high-versus-low significant tasks (Question 3 or 4) for 
workers in each cluster. Patterns* of backgrounds and tasks should become apparent.* These patterns 
convey the nature of work done, and by whom, that characterize a cluster. From such a pattern^ 
and Its different from patterns of other clusters, it should be reasonable to generate a label that 
effectively ^mes the job types. 

' . i * ' 

STEP 19: COMPUTE SUMMARY DESQRIPTIVE DATA 

This step assumes that specific occupations have been identified, either by selection (Step 1 ), 
by respondent backgroundlStep 9), or by analysis of worker clAters (Step 18). ThSh, for workers 
within a particular occupation, responses tft each task are summarized to reflect that group's descrip- 

, tion of their work. Similarly, ratings focused on such workers by su^Dervisors are to be summarized 

- ^eparately to reflect as a group their view of expected job performance. 

As noted earlier in the design stage (Step 10), these response summaries for each task can fake 
the forni of average ratings,' measures of dispersion of those ratings, freqiency distributions, and/or 
percentages of varipviS' types dfre^nses. Computers are ideal for computing these summaries, al- # 
towing at the same time for comparisons to be made betweert the task summaries of different kinds 

of respondent^. . . ' , * - ^ 

/ * ' ^ . » ^ ' 

Volume 5 providerone computer program for summarizing task data and displaying the results 
as noted in Table^l and 2. But a variety of other computer packages now exist for doing comparable 
data processina. The SOUPAC program developed recently 3t the University of Illinois (1974) and 
widely distributed, has this capacity (using the MATRIX and TRANSFORMATIONS routines to set 
up the data, the STANDARD SCORES routine for means and standard deviations, and thp CORRE- 
LATION routine for measures of relationship between responses by any two groups of respondents). 
And, a recent announcement (Knox, 1976) by the U.S. Department of Commerce's NatfonaJ Tech- 
nical trjformation Service (NTIS) indicatesstheir nevvCENTS-AID II program p^kage is an efficient 
process available for purchase. Incidentally, rtiost S^roms can also produce printotjts on plain rather 
than I4ned paper,^ This feature provides camera-ready copy for use in printing reports of survey re- 
^ sultsistep 21 ) without retyping the data summaries? * ' ' - 

• * In ad^ition^ the descriptive task data, several other computatior^.9an be made to charactei-fze 
thesurvey population and their response to the survey: ^ 

• Frequency distribation of re^onses on standardized categorf^s for each backgrqiind ^ 
question, effectively taUyiriCtFie use of each category of response. ,. ' * 

• , Summarization of ratings on ^ch reaction statement, to note relative perceived rherits 

of different aspects of the questionnaire associated/wii*i a particular xjccupSlion. 

*• . Average number of t^sks cited'as som€f part 6f the job by w|>rkers, a&d by supervisors. : ^ 
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Distribution of responds to each spate category ^ Questions 3, 4, anji 5, as Jfiimmed 
oyer all tasks and ajl respondents ma particular group. / ' I 



These additional descriptive result! can be jeport^d along with the formal 'djocumentation of^^ 
task data summari^<5tep 21). *. ^ ' • ^ 

STEP 20: PERFORM ANALYSES OF THE 
SURVEY DATA > . 

s After group summary dat^arfe avaiJabJe (Step 19), a number of diflerent analyses can be per- 
formed on that dataf^me are*apfiropriately appli^ to a $jngle%ccupationVother's are appropriate 
when n>ore than one occupation was surveyed.- Figur^^notes^a number of useful kinds of anal- ^ 
yses using respondent background ^ry4 task relevancy'^jj^; These are differentiated in the figure 
as to whether they are applicable to single or multiple surveys. E.ach is discussed sepiratefy below. 

ft 

Interrater reliability.^ Scaled questions such as Questions 3, 4, and 5 can be analyzed tofnea^ 
sure the ex^tent to yvhich the*faters .within a group pcovid^ed reliable response on tf^quesj/on-. . 
Jnt^dl|;er Reliability'^?, each ques^^bn Jiiiay be calcuiatad by>n analysis of vartence prbGemjre^ ' 
XWinep, 197 1 , pp. 284-296) which yields a mfeasdVe of trie tJegree of agreeVnent within a group'of* 
raters. This measure can also be adjusted for differences in ^ach rater's frame pf reference (mean . 
rating Qf inlilvidual, as compared *tq mean rating fof^composite o*f allVaters), This adjustjnertt pro- 
tJuqesV reliability Tneasure free*of aP^y source qf variance due to irfCHvidual differences in such \^ 
^ frames o^^eference. ' * ^ • ^ . > ^ ^ 

Many.i^iiversity computer systems have e)fistingprograms for this analysis. ^ . 



FOR A aN GLEOCC UPAtiQN' 
— : ■ 



Interrater Reliability " ' * 
Rel||tjonships BetweeivTask Questio'hr^ 
Task Pert orijjpnoe by One Particular SubgroiUp of WorJ^ers 
* Subgroup Coftipiairisons: 



Based on Different Backgrounds of Respondents * ' ji 

iller and Supervisor Responses ^* 



^J)jfferenoas Betwean Wonler and Supervisor Responses 
essment of Task Relevant 
Compotife Jo^ Descriptions ^ 



Assessment of Task Relevancy to an Occupation^ . 



FOR COMPARISONS BETWEEN OCCUPATIONS ♦ , 

— • . ■ • — ^ — ^ 



^ • . Bac||;ground giff erences • 

• Ovedap of Tasks ° - ^ 

< • Key Distinctions Between Occupations 



figure 23, Possible analyses using background and relevancy data. 



^ . . 0 \ ' 

RatotiymNps befyeenlask questions; Thejel9|ion::| 

lie measur^dJfty computing the correlation between th^n 

Cdtrellfionat computatiorvsjcan be handled routinely bv 

are a q^mp(inei1t.of a number of wid^y available prograr 



^een two different task questions can 
^ecjive arrays of summary re^onses. 
ist ar)y univprsit^ computer center, and 
Dackages. \ • . 



f-kdrs: With a su^ficient^y hjgh number'of 
jmeihteresting and useful descriptions of 




Task performance by onorparticuter subgroup of/w< 
respondents tc/^eld stable subgroups of worker t 

task perforpnance can be prepared for a particularHf^ed subgroup. For example, one mlght-wPsh 
' ti^Sfe a-descriptioij^f the tesks most performed by workers in a given part of the country whoo^ 
eme'a particular type of equipment, and who have been on*the*job for two years or less. A 
tion lik^ this can be prepared for any group of workers a^ long as they can, be defined in termi o 
informatfw^ the background section t)f th&questionnaire, »^ r ^ , 

' . Subgroufrcbmpafrisons based on different backgrounds of respondents. Again with a sufficient 
nunrYber of respondents, comparisons between subgroups of Respondents with regard to task occur- 
>rence or^significancacan provide interesting clues for training or manpower requirements. A com- 
parison of tasks performed b/experienced workers^with those performed by newcomers to a job 
>videi useful insights about the needed content of multilevel training programs. 

iK^istrib^*'""" ' 
tjally received 
trisined 

in^g. If ^re were 
ing^ eith 





Tdef initewPfe^ence, pos'sible changes might be considered in the content"Of train- • 
^b or informal school programs. Up 

As the reader will recogniz^l^variety of such analyses are possible, deftending on the background 
daiaiarid^ the number orf survey respondents available having each type Of bacllground. However, no . 
^direct ,dbmparis(5n of subgroups is possible unless specific item^f background information are ob- 

tained in the survey. It is for this reason that importance is attached to preplanning in Steps 9 and* 
^ 11. ■ • . ' * .4, . • . . 

Differences betweeo worker^and supeTvisor responses. As previ<5a|h4.npted Hi Table 1 1Step*tO),» 
* it is possible to compute and display the difference between the averag^sk responses {>f workers' ^ 

and' supervisors. The &me»would be possible for Questions 3 and 4, except none of the question-.^- 
^ nairg types^ (Figure 2) admfmster these two questions simultaneously. ' ' ^ ' • 

• When there is a larje disCr^ncy between worker and supervisor respon^^on Questipms l^and _ 

2, this suggests where there may be real differences in perceptions and expefctations. Differences . • w 

shoulrf^be relgjively large, generally of an or(Jer of 20% or more (such as when 25% of the worfcer^s ^ ^ 
' checktheJaskasdone, but 50% of the supervisors e)cpect workers to^Jo^t). . » ' * ^ 

* Such differejjces warr^t further examination to establish thejreasoafor each devotion and, its 
meanirigfulness for the purposes of the sUrvey. Questions 3 and,4 answered by different persons 
than responded to Questions^l and can be used to provide Some interpretation whece,iarge oc- 
currence differences exist for a task. For instance, the discrepancy may be qp.a ta^l^^f pnl/snf\alf- 
to-moderate sigrHficanc^I The task statement itself shotild be examinedfor clues to Wnatune or 
cause of any differences between group responses. Very few major;diTTerences are to tie expected / • 

a survey of workers and supervisors, when task questions area^ed at a brpad level of job aware- 
ness. Additional information to aid in these interpretations isp>#ided when the task questions ' 
■ of Volume 4 are add^Tto the Task Inventory Questionnaire.^ Discussion of these instances is ton 
tained»in Volume 4. A - . * . . 
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fables {jl^inting Mt summary' data for Questions 1 and 3 provide a means for comparing dif- 
• \ ampoces in responses to those two questions. However, those two questions are not directly com- 
^' »' ^BrbWfe. The "0" rating on Question 3 is n6t used by workers the same way as "not checking a task" 
; { or^ Question 1. Apparently workers tend to use scale levels of 1, 2, and even 3 on Question 3 to an- 
, ^ticipate tasks they mT^t be ca^ed upon, to perform * 

Aswssment of task relevancy to an occupation. The procedureSn Volurha 2 for listing tasks is 
' • ' to include them lithere is any doubf Of thein^elevancy, and subsequently to use 8^ 

sure the extent to. which each\askj»relevant Jt can then be anticipated that some of the tasks will 
. be determined not to be releyam-tonjie occupation sJkeyed, and some will be only peripherally • 
relevant^ With only a' few workers^ cooing and expected to do such^ tasks^ ^ ' 

For determining t}ie minimum jidint at which a task can be ruled as relevant to the occupation, 
' consider only those tasScs which are marked as performed or part of the >ob by more persons than 
. ' \ might be expected to mark in ^rpr.' f^out 10% of Itie' responses tb a task can be considered withirp 
that margin of marking error. . . - j 

'jj^'^eral rule for usiog survey data in establishing a task's relevance to ag occupation Ls sug- 
gestWasr \ ^ . . . ; \ > ^ ' ' 



r-V-/ 



Reject a task as being def^'fjitely not relevant when less^^than '10% of tjie ' 
^ workeri indicated 09 Question 1 that they.performed it and less than 
' 15% of the'supervisors irtdieated on Question 2 that such workers should 

perform the task.. . * ) 



Jjie value^for this rul^, which uses questions from st/i^ey Types B anci £> (Step 8), can be dismayed 
as follows: . ' • " ' * \ * 



{and) 



Question 2 < 15.0% 



Question 1 '< 10.0% 

TKe higher supervisor percentage accommodatesvatenoencV, for supervisors to rat^a greater number 
of tasks as part of the job;^ince they are-jUdging a group of workers, rather than the assignrnent of 
one individual worker. ' * \ 1 * ^ • ' • 

# . ; • . . . F ^ ^ . ■ - 

R^Sonably comparable rule values for the other jurvey typeS" (per Step 8), using summary c|e- 
■^iptive diita for ea<;h tjisk jas determi/ied in Step 1 0), are a§ follows: J • N A 

7r ' ■ •■ 



(andT 



Question 3 Mean < 0.7E 



Question 4 Mean < 0:75 



' ^ Question 1< 19,0% 
Type€ 

^ Question 1 <10.0i ' (and) 

; . JypeA^ ' , \ J ^ ^ 
* ' ^. * • . 

Question 3"Mean ^ 0.75 ■ {andj , . Question "2 < 15.0% 
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, These rule values can be applied cfuite readily hand when computer Iprintdtit tables such as 
those shown in Tables A-2 and A-3 df Volume 5 are prepared. TheS tables summarize th^ task re- 
sponses to Questions 1 and 2 (Occurrence) by 10% intervals of the percept perfomving or desiring 
performance of each task. Jj^in Volume 4, specif computer routines are cited, along with routir 
for other rules used in seiecfTng for training thenipFe critical tasks of an occupation. ^ 




Values assigned to each rule are somewhat Vtfitrary-. The values suggested her? have/BlSn tound 
^to be meaningful. arid effecti\tosj[p«; occupations feWhich j typical worjjier currently performs about 
or>e-third to one-h^f 9f the tasks whioh^re relevant to that*occupation. This seems to be a sitAtion 
common to many occupatipris. \ ' * ^ . - ~ 

There are exc : Some occup§tibns cart Ije highly prescribed, such that nearly 

all workers perform a high proportion of the same t*ks. Thiscan occur, for example', within a 
single large employing firm where workers are-bpund by aset ofdirectiviis ^etailing^hat Vvork ?s to . 
be done by those employees (such as safety Inspectors, guards, bookkeepers). 

A^difficulty arises when one large part of i job is f\>(eci by directives, but the remainfng portion , 
is flexible to vary from one work situation to another. This* can happen, fownftanpe, in, teadersfi^ ^ 
jobs which alto involve t^ni^al bpferation of complex eijuipment. The technical ^ration pbrtiort 
of the task list may be^gairated from, the leadership portions, with different rule values. th'cn ap- , * 
plied t(f each portion. -fhMoveming consideration is that the result of thp rule applications shoiifd . 
jn^ke good sense to persons Knowledgeable aBout that dbqjpation. A few such individilals ^ould.be^ 
asked to /eview the tasks futed refq>/ant and;nonrelevant, and express, their views on ^^y specific tasks 
which appiear to be inappropriatjBly*classif ied. ♦ ' \ . ■ ; » , 

Compositejob deiM^ipti'ons. Given a determina^rbf which of the tasKs*Jisted,in a Task Inven- ^ 
tory Questionnaire are relevant to some degr^$^thes«an be listed separately f^the partic^rlar ppcu- 
pation., A useful system is^to list them in rank ocder within eaqh duty category, basfed on thp responses 
to Question 1 oV Questipn3. Associated with eactj tasl^statement'can be cited the summary descrip- ^^^^ 
tive data from' e4ch of the questions used. This yields an. overview of the«eccupation which can bfe 
guick^y scanned for information on tasks Of- high relevance. Pigqre 24 illu^strates in abbreviated form 
what such a job description might look like. . * / ' , 



When several occupations within an areaw^re suM/eyed, separate listings tff'relevaht tasks for 
each occupation should be prepared. A gckxJ example of this is outlined it) a study by Bferger (1974) 
in his survey of tasks performed by computer proyammers. In that instance there were three pro- 
gramming areas which defined d1ftei<ent programming occupations. Additionally, three career* levels 
were based on length of experience antf job title, differentiating between effectively distinct job types 
within each programming area.- Berger presented i schematic representation of the sets of job descrip- 
^tS6i^ appropriate to that occupational area: " 7 , . . ^ ' 

*^ . _ ^ * 
V ■ ' \ ♦ J Programming Areas y • 



Business/ 



Scientific & Systems 



Junior or Entry-Lev^ ' * 






• « 


Pro^ammer r . * ' 




w 




Senior Programmer , * . 






^1 ' 



TASKS OF AUTOMOTtVe N|ECHAniCS 



UULam^a^m — — 

fwOfmmng rmCmn 

^Ptrformifif 
(Quirtioni) 



;trs. Extent Jmk Is Part 
thafiwltion l O iwi ti o n 3> 



Supervisors,, ^ctm 
Expecting Performei^ios 
< Questio n 2) 



»h — ' 
Mefn ^ 

Reting 



Percent Retkig 
•tLeMte^ 
tiel Pert 9f Job 



tt 



fDUTY C: 
117:' 
155. 
160. 
* 132. 

• 140. 
126. 
125. 



154,. 
•^29. 

134/ 
161. 

UTY D 
.162. 
163. 
369. 
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ENGINE OVERHAUL ACTIVITIES ^ , * 

Adjust valves. 

Repair or service qrankcase ventilation jystem.^ , 
ljun c6mp>ression test. ' • i ^ 

' Perform operational inspection pdsitive cranked 
ventilation system. 
Replace Engine;, maunts. 
Diagnose valve train and head mal^uncttons. 
inspect exhaust systems. 



^Replaoe^vafv9 s^ts. 

M^^ne^ vaiVe guides for special seals. . 

Rebuild rocker bo^. « 4 

Rebuild.cain followers/ 
yh^9nfil^\ >oles and cracfcs in blocks. 



MAINTAINING AND REPAIRING HOWEB TRAINS^ 
, Adjust external shift linkage on manual transmissfons. 93% 

Adjust mechanical-tYp€|jclCitc*h. " ^ "93% 

. Lubricate speedom^er cable, drive gear, and housing. " 92% 



92%' 
> 92%^^ 
92% 

t 


100% • 
* 99% 
' 100% • 


4.3 ' 
5.3 ^ 


66% 
63% 
85% 


90% 
90% 
88% 

. 88% ; 


^ " « 9>% ^ 
^ 99% > 

100% 


• 

4.4 
4.5 

5.0 . 


70% 

' 6^ 
"86% 


.-38%' 

>>5% 
y ?2% • . 
/ 18% ' 

18% 


46% 
55% . 

. 3§% t 
i 30% 
20% 


1.4 • 

V 1.8 * 

. 0.9 1 


- «% 

21% • 
18% 
12% 
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RebuilcToWrdriveuMt.V \ - 37% ' 

Balance dijve shaft (iij-car).^ ' ^ ' 27%» 

Straighten rear housing to correct excessive tire w^. 12^ 
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Figure 24. >(^bbr9vtated example of a job description 
Dif tuski for jan occupation. , \ ^ 



r 




Each of the nine reiglting job descriptions separately sumryiarized an Ojccupation or job type. Some 
tasks appeared in several or all nine descriptions; others occurred irt on(y one or tvyp of^them, as 
tasks judged not relevant to^n occupation were omitted from that particular listing./ ^ > 

. , c ^ ^ 

Berger (1974) also defired five different types of job descriptions: 

' * - t , 

1. Universal. < I 

2. Ideal. * 

3. As-Practiced. ^ • • 

4. Specific Focus.- • ' . 

5. Organizattonat. 

Each o'f these type? may b^ of espejcial utility for various purposed of work management, career 
Qounseling, training curriculum content, establishrment 5f professional or craft membership sta 
dards, evaluation of worker perfor/nance, or employment selection. In the context of Volu 
these five types of jo|||despiptions would be defined as follows: . ^ 

UNIVERSA^JOB DE^CRli^TION: ^Composite of^ tasks judoed as relevant to an occupa- 
tion by both workers ind supervisors, such 'as determined by relevapcy rules noted 
f f earlier.^ " ^ . ^ . ' i 

IDEAL* JOB JSte^lni ION: 'Comprised of, tasks judged as relevant by only the super- 
visors, ustt$^g^|^^^ 2 and/or Question 4.. , ' 

^ * ^ □ •AS-PRACTlCEO JOB DESCRIPTION: Comprised of tasks judged as relevant by only the 
/ workers^ using Question 1 dnd/or Question 3. . ' 

^ P JSPECJFIC FCiOUS JQj^DESCftlPTION: Similar to the As-Practiced description, but 
•'focuffng on task performance of a subgroup of workers. Selecting some element of back- 
" *^ grbupd'informatiQn, (such as length of experience, type af training received, type of main 
/ pquif^wit operated), a separate description of perforrpance can be prepared for a specific 

subgroup^f workers. • . , ' 

□ Q^^G>?^Nj<i?A)^^0^ 

^^^^pes^'t^Uimited to'^task responses from within a particular or^nization. This descirip- 
\ tic^ni^flf^ relevar^cy of tasRs as the occupatioojserves^the mission and with 

^^^^Th/r^feoVf^s of a specific eraptpying fjrmT ftlsesi^ially iiasful to an organization-wish- 
' . ♦ . / ing^tO taWor a job'descriptiort-to its own uwqlje reqi^ ' 

; • • . cam9?<^ its situation with the general fi^ld'of emptoynjppt for an occupation. Such corp- 
• ' ^ i^risons coul*b€ usefunntjelping tqklentify tasks for which post^fnployment training 
. • . . ris w^rantdd for new employees,. wh^er from ^n occupational training program or from 
, I * ' - '.L* <5t^ employing organizations* . ' ^ ^, ' • 

Oc^,patior^ aompariion$ based on work^ri)ackgroAnds. Data. from the background re- 
/ ^^nses of wo^tcers ci^rt ^e'sumgnarized IseMMfely for each coroplete occupation or job- type sur-, , 
I " J veyed. These ^slimnairies, when cpmparedTy^lcl ^idence of. similarities and differences of workers 
- / ^ irr these occupations. Such i6mf^afison could be based on aqy or all of such pfiatters as: » 

■k-: ■■■ • ■ ■ ■ • • 



I. Average length ofwork experience. 
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,2. Lengths of. work expcrieru;* of the middle 50% oUhe workers in e^h occupation (that is, 
the semi-interQuartile rang^.af ex^perienc? years4:ited by .those workers, omitting the 25% 
havin§ th^ least expetrrence and the 25%t»aving the most experience). 

• - - % ' 

3. Primary sources of occup^ional training. ' ^ ^ 

4. Types of industry where employment predominates. 

5. Major types of equipment operated, used, or maintainedl^ 

^ OccupatioJ^.I coJffparisons based on overlaps of taiksjjerformed. Taking the separate jgb de- 

scriptions described earijer, it is possible to note where completelydifferent tasks are perfdrmed 
in different job types, arid their relative^ianificance to each job-. Sjmilarly, where the same tasks . 
are performed in different jobs, major difference in significance or pei^ent performing can also be 
* noted. 

§ 

\^ ' Occupational comparisons noting key distinctions differentiating jobs. Examining only those 

tasks with reasonably high levels of significance or job occurrenqp from the overlap comparisons 
above, estimates.of the task performance characteristics thai differentiate between those idfes-c^ be 
obtained. This examination wilflfelp identify those tasks m^st representative of a jobi)riob cluster, 
distinguishing that job fronri^ related jobs. V . 




ACXrVITY G: REPORTING 
THE SURVEY RESULTS 



DESIGN THE SURVEY- 



Plan Data 
Analyses 

• Needs 

• Task Information 
^ ^f»formaoT - 

Backgrounds 

• Data Summaries 

Steps?. 8, 9, 10 



Design Question 
^\ * natres kn|f^ Their 
Administration 

• Format and 
Sampling 

• Pretest 

Steps 11 and 1 2 
^ 



■ i 



OBTAIN RELEVANCY QATA 



Administer 
Questionnatres 

• Arrangements 

• Instruction 

• Printing 

• Recognition 

Steps T3, 14. 15, 16 



Process TIQ Data 

• Preparation 

• dlusters (if 

needed) 

• Summaries 
, Analyses 

Steps 17.18. 19.20 



Report the Data 

• To Partictpants 
A Formal f^toord 

• Future File 

Step21 



STEP 21:<PREPARE REPORTS OF DESCRIPTIONS 
AND ANALYSES 

In addition to whatever internal reports are appropriat^rH^ a'SP recommended that severa* 
other reports be prepared, if not already included in the internal report system. These additional re 
ports are for the purpose of sharing the survey^results with others. 

Feedback of rtsults to survey participants, While it may not feasible to communicate with 
each questionnaire respondent, it is an expe^ed courtesy to provide a short or popular description 
of selected survey results to participating erriptoyers, associations, and key local administrators. 
This need not be' a large or fancy printing, but a gesture of appreciation for their valued assistance. 
This^ feedback repor| should be prepared and distributed soon after the survey adm'irystration is' 
corhpleted, when some meaningful results can b^ communicated. Portions of the an^tyses could be 
reported to the membership of pertinent professional and labor associations thrPugh their period- 
■ icals and newsletters. ^ ' 

Fof mal documentatton of descriptive summaryjiata. A report tf the survey ?ffort and sum- 
mary data on tasks of an occupation should be preparecl to share these results with others outside 
the agency- sponsoring the s>*fvey, whenever such sharing is within the policy of that agency. This 
r^rt should describe theprocedures that were used 81 developing ^nd administering the question- 
naire and the descriptive findings that were obtained. Such a report provides a permanenit and 
dated recprd of the effort and can also aid others in their efforts to construct and analyze Tasl^ 
Inventory Questionnaires. 



A auggetMd aiittine of the format report is as follovys: 
In&oducthn 



I 

A. Purpose of the Survey " J 

B. Definition of the Scope of Occypational In^rest 

C. Definition of Key Terms Used > " * . 

Methodology * ' . ' , ' - 

A. Construction of the List of Tasks - 

B. Characteristics of the Samples^f Workers anIrSupervisors (types, locations, 
industries, experience levels) ^ 

C Dafa CollectkDn Procedures (methods, dates) % 

D. Analyses Performed (basis oiAvhich r^t^veHlcQi^ras established) 

Description of Specific Jobs - ^ 

A. List of Relevant Tasks (validation of tas^ inventory) • 
\ B. Sumrtaary Task Daja ; , Y > ^: 

C. Tasks! Added by Respondents 



Description of Respondents 

A. Background Characteristics , 

B. Equipment Usage ^ 

Analyses / . ^ - . 

A. Scale Usage and Interrater Reliabilities 

B. Other Analyses as Available and Rejx}rt^le 

Implications of Findings ^ 

N^, It is recommended that the report employ the writing a^ format :style as established by the 
Publication manual,of the American Psychological Associati0ft(1Sr74). The publication style of 
this manual has been adopted by over 120 journals and periciticsils in the fields of education, psy- 
chology, guidance^ ahd other social sciences. By its use, portions of the report couW become readily 
convertible to articles in such journals, and not require th^prej)arfftionj6f the material by tw^ differ- 
ent style guides. / 

For sharing the report with others, the following document clearinghouses and repositories are 
suggested, along with others that may be known in particular occupational fields or by sponsoring 
organizations. ' . 

E*R IC Clearinghouse on Career Education ; 
The Center for Vqpational Education 
1960 Kenny Road 
Columbus, OH 43210 

(operated under the sponsorship of the National Institute of Educiattorf, HEW, for t 
documents in the areas of adult-continuing, career, and vocati^al-technicaf edu- 
cation) ' » ' ^ / " . ' i 

' / ' ' ' 



Task Inventory Exchange (TIE) * • 

The Center for Vocational Education ' 
1960 Kenny Road 
Columbus, OH 43210 

(operated as a service to education, government, and industry to promote the ' 
sfiaring of tash/fnventories and related methodologies, providincj one-copy reproduc 
tions at cost on request where copying permission has been obtained) 

National Technical Information Service (NJIS) 

U.S. Department of Commerce . . ^ 

5285 Port Royal Road' 
Springf ield; V A 22161 

(a central source for the public sale of Government-sponsored research, develop- 
ment, and engmeering reports and ^ther analyses prepared by Federal agencies or 
by their contractors or grantees) 
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APPENDIX 

SOME OTHER POSSIBJLE 
TASK - RELEVANCY QUESTIONS . 

•These aWitional task questions are cited +iere only for their potential value to the user of this 
vdlufhe \fi special circumstances and needs that might b^hcountered, such as when additional per- 
fornvance variables jare desired to enhance an occupati^[l de^iption. These other task que^jtions 
are not part of the process generally recommended in this volume, and no.further description's 
made of them. However, Jata could be* processed in a" fashion comparable to the methlKis cHed in 
Step 19, Compute SUrtimary Data. ThouQ.hiio specific recommendation is made for their use in es- 
tablishing job relevancy, for the' readers' information these other !aS|^|iijestions include those per- 
taining to: ' ^ . t . ^ ^ 



How often each t'ask is dorfe. 
2/ How rmportam is each task. ^ 
3. - ' Performance time, ' i 

PERTAINING TO HOWXXFrEN€ACHTASKlS DONE • ^ 

V Actual Freqaency of Performance (asked of y^orkers) s 

\ ' \ ^ , 
• Within the last year pr so in yogr present job posit k)n, about how often have ^ 
been p«erforming each a<5tivity done Jt)y you (as'checked in Que?t^ 

Response Scale and Abbreviated Questionnaire Symbols: ' 

0+ NoflRally not performed; tkrt have done so in a very special or pnusual 

^ . cirwins^rtice. " * ' > ' ^ - 

• t 

• Perform the ^ivity, buft much less often than once a year. , 

Perfdrm the activity about Jince a Y£AR oh thre average (but not a?' 
^ often as once a month), fj \^ 



f 



, 1 M Perform the.activity about once a MONTH on the average (but not as ' 
^ often as once a week). ' ' 

1W -Perform the activity about^once a W^EK on the average (but not as often 
asdnceaday).^^ 
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ID Perform the activity a^)ut once a DAY on the average. 

D+ ferform the activity several times each work day. 

• Reference: Ammerm^n^ Pratzner, i974. 
This corresponds to Question lO^or which the computser, program of Volume 5 
calculates summary values. ^ \ * , 

• Preqiiency BTask Perforin ance f asked of workers)^ . ^ 

How frequ€?ntlydo you do the task? « ■ >\ ■ 

' -.-T, .■ . r/-' > -•, - \ ' ■ 

Response Format: ... , 

INumber) .times per:(time unit in jterms of'hour^ day, week, month, or yeaH- " 
' ^ i : ' - ^ : - . , " I? * 

^- 4' Reference: Fruchler, Morin, & Archer,' 1963! ' / 

I Frequency of Task Pferf^nciance (asked of workers) , ; . * ^ ' 

* H'qw often do you perform this task on your job? ' * • 

Response ^lepncf Values:. ' * ' • 

IDaily. ' * - V^BO ^ [ • . 

: !^k1y.' ^ r : ♦ V 

Monthfy. ' • ' \/lT". ' * i ' , ' • 

Quart^rly.^ ^ 

. Less th^rr quajft^Ty.' 

(res^nsb value calculated a; the sqyare rpot of the ^nual fPequency of 
. r perffknance) ' ^ . " \ 



Ref efence : ^ CHamt^tam, 1 964. , \ 



I Desireiii Fr^ii^cy of Performance (asked of IfTimediate supervi^^ 

> From'ydP^e)icperiencQ as a'supeijvisor^ judge about how often a typical yvorker in 
yt^ir bperati(2^dujho^ each of%& activities you checked (iri Question 2). 

' ^ A Base this judgm^t not only on vyhat you feel would be the most desirable fre- 
quency of performance, but also on what it is reasonable^to expect any one worker \ 

* • to do. V. * t^" ' 

Response Scale and Abbr^iated Questionnaire Symbols: > * ; ^ ^ 

. • 0'+ Normally should wever perform the activity, but might do so in a speptal 
, -» &f w'^usuel sitliation. ' • . 

^'^ • ■ ■ • / • • ^ k . 
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Y- Should perfdrm the activity, but much less often than^once a year.' ' , 



• 1 Y Should perform the activity al?out once a YEAR on the average (but , 
not as often as once a month). 

• » * 

1 ML Should perform the activity about once a MONTH on the average (but 
^ npt as oftfen ps once a week). 
♦ -- — 

IW Should perform the activity about once a WEEK on the average (but ' . 
not as often as once a4ay). • ^ 

V ^ \ 

S^uW perform tbe^tivj%y-abo4djt once a DAY on t^ * 

D+ . Should perform the actjvity, several times each work day. 

Reference: Ammerman & Pratzner, 1974. 
^ This corresponds to Question 11 for which the computer program of Volume 5 
calcy^tes summary values! 

» Frequency of Performance (asked of training instructors) " 

. How olteh is each task performed during the performance of the jot^ ■ ^ 

V ; • Response ScaJe: v ^ • ^ 

- Very rarely. f ^ 

Once in awhile. ' ' 

^ frequently. ' ^ . 

" Everyctey occurrerice. • 



Reference: Mager & Beacli, 1967.;^ V - 

Last'Tirhe Task Was Performeil (asked of woi|kers) 

* ■ 

When was tTie last time you performed ^is task? 
Response Scale: 

- , ' a. Within the ^tet 3 months. 
^' b., 3 morfths to a year ago! 
. c. More than a year ago. 

d. ' Ney^ while at this jobpositidn. 

" Reference: FVuchter^-Morin, & Archer, 19©^ 



PERTAfNING TO HOW IMPORTANT IS EACH TASK 



mpor 



4 » 



JmZJRrtance of Tasfc {askl^|pf workers) 

How imf^rtan'^is eacft task to yoiir job 
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Response Scale: 



J. Extremely unimportant. * 

2. Very unimportant/ . - ^ 

^ ' 3. * Unimportant. - ' ' . ^ 

4. 'Atjout medium imponance. 

5. Important. ^ % 

6. Very important. 

^ 7. Extremely impdrtant 



) 



Reference: Morsh & Archer, 1967. ^ - 

^ : "~ ' . ' ' • # ^ 

■ Task Importance to Job (askefd of workers) 

' \ ^ ^ 

Whay/e!^rei6 of Importance would you assign to each job activity you g^form (as 
checKkl in Question 1)7 'Judge the importance of each activity in regard to its 
^ contribution to effective operationsjn your off ice or firm. m 

* ^ Response Scale and Definitions: 

<^ ^ Hfgh Importance - an essential part of your job, in that its per for- ^ 

* ' • \ ^ manceby you diec/s/h^/K influence^ the effective- 

*^ ness of your office.or f irtff s Q0erations. 

Moderate Impwrtaoce - an inipc^ant (but not essential) part ot your job. 
0 .That is, your, performance of the actm^/uat^. 

^ _ ^ .1 _ ->Aa//^-Jbui not decisivdv) influfic^^ 

^ess of your office or firm's opefiralions. ^ 

^ " . Low' Importance - a re/atl^ely unimportant p^rtai ^oh^iob,^ that 

^ , ' . • \ \ 'its per^rirdhce by you does not materiallvt influ- 

1^ ; ence'^ the effectiveness of' your off icef or* firm's 

• • ^ operations. ♦ ^ ^ / 

Reference: Ammermah*8e Pratzner, 1974. '^9 ^ - 

/ * ' This corresponds to Question t2 for whfch the compirfer program of Voltfme 5 

' ^'^ * calculates summary values: # 

^ * ' ^ Task I mpprtance to Job (askediji supervisors) 

' Based upon your supervisory .experienfce in^your present operations; .vi^at degree ot 

" r . importance would you assign to each job activity that is appropriate for your ... 

' ' workers (as checked in Question^)? Judge^the importance of each activity In te- 

' ^ gard to-its contribution to effective toperatfons in your office or, firm. . . 
4ttt. - % 
•* V ' • ^ - " ' . 

' In making these judgments of activity importance; assume thatno helper is tempo- 

. ^ . rarity assigned to assist your . . . Workeft)., Activities of persons, in related jobs may 

^. • . * be important to your tptal operation, but only, the performance by . . . (workers) 

' ' shouW be rated here. " . !• * 

' > I « • * 

'' • . ■ Response Scale and Definitions: I 

• . • ./ /.• ./ ' ■ " 



High Importance 



Moderate Ihnporta- 



■ ; A- ■ .. 

arv essential part^of the w<?rkers' job\ia that its * 
perforhiance by the . . . (workers) decisively h- 
^ fl^iences the-effectiveness of you;; office or farm's 
* operations. 

• » * 

- *an important (but not ©ssenitial) part of the jo^. 
That is^ its performance ^y the . . . (wprkers)' « 
materially (but not decisively) inflaences the 
ffectfveness.of your office or firm's operation^/ 

— Low rmpofiance" » arehitively unimportant part of the job, in that its 

^jM^erformance by the i . . (workers) does not ma^e- 
. * rially influence trte effectiveness of your office or 
. . • • firm's operations. 

Reference" Ammerman & Pratzner, 1974. ^ . 

This corresponds, to Question 13 for which the computer program of Volume 5 
calculates summary values. #^ * 




Criticality to Job Perfonjianc6-(ask€3 of workers) 



In relation to the other tasks of your present job, how critical is this task to your 
job performance? ' » ^ ^ 

Response Scale: 

A . ' . 

^ 1. Least critical. " ^ 

2. Below average. . ^ 

3. ^ Average. 

4. Aboive average. , * . • , , 

5. Most critical. ' ' 

* # « • 

Reference: CHaiyiberlaln, 1jW4. ^ 




PERTAINING TOfERPORMANCE TIME 



i time NeedM to Perform (asked of workers) 



How mKh ti'm'e does it usually take to. perform the t^sk once? 
' Response Format;^^. ' : 

Jhumber) (tim^ unit in se^oncTs, minutes, or hoOrs).' 



Refjr^nce: Ffuchtef, MoHn, & Archer, 1963. 



Additional questions yielding possible indices of the training need fpr rejev&nt t^sks are ^ted . 
in the Appendix.tp Volume 4. T<hey pertaiA to i|sues-ef difficulty of task performance, experience 
f^uirementsy estimates of tramingVequirements,;and dimCuJjy.of the'learning. J . 
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